A method for evaluating the wiring fatigue state of a patch panel based on eye movement angular velocity characteristics
By collecting eye movement angular velocity characteristics using MR headsets and combining them with an eye movement-fatigue evaluation model, the problems of large interference from sensing devices and significant subjective influences were solved, enabling timely and accurate assessment of the fatigue state of wiring board cabling.
Patent Information
- Application Number
- CN202310330039.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-03-30
- Publication Date
- 2026-11-06
- Estimated Expiration
- 2043-03-30
AI Technical Summary
Existing technologies lack timely and accurate assessment methods for fatigue detection, and the sensing devices are subject to significant interference and subjective influence, making it difficult to assess fatigue before it becomes apparent to workers and students.
The characteristics of eye movement angular velocity were collected using MR head-mounted glasses, and fatigue diagnosis was performed through an eye movement-fatigue evaluation model, including eye-line vector coordinate transformation, eye movement-fatigue analytical model and extraocular muscle exertion state analysis. The type of fatigue was determined by using eye movement angular velocity and extraocular muscle exertion characteristic indicators.
It reduces interference with operators, improves the accuracy and efficiency of fatigue assessment, simplifies the assessment process, and reduces subjective influence.
Smart Images
Figure CN116439704B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the fields of mixed reality technology, computer algorithms, and fatigue detection, specifically to a method for assessing the fatigue state of wiring in a junction box based on eye-tracking angular velocity characteristics. Background Technology
[0002] Currently, in the manufacturing sector, the daily practice of high-end manufacturing skills and the training of talent still rely on long hours of hands-on manual labor and instruction. During this process, workers and students inevitably experience physical and mental fatigue. However, the field of fatigue detection lacks an objective diagnostic method for timely assessment of human fatigue. Existing fatigue assessment methods are insufficient to assess fatigue before it becomes apparent, and the subjective influences in the assessment process—including assessment standards, methods, and results—are too significant, hindering the scientific development of human fatigue detection.
[0003] To address some of the aforementioned issues, the patent "A Fatigue Detection Method and Device Based on Eye Movement Data" [Patent No.: CN106073805B, Authorization Date: 2018.10.19] discloses a method for fatigue detection using eye movement fatigue characteristic data such as the subject's reaction agility, pupil diameter ratio, and blink frequency as input into a machine learning algorithm. However, this method still has the following shortcomings: 1. Requiring testers to wear a series of complex sensing devices such as eye trackers inevitably has a significant negative impact on their operational state, indirectly affecting the authenticity of the raw data; 2. Over-reliance on "black box" machine learning algorithms like BP neural networks results in fatigue assessment accuracy based on complex and diverse databases, which lacks timeliness in actual field use. Summary of the Invention
[0004] The purpose of this invention is to provide a method for assessing the fatigue status of wiring board based on eye movement angular velocity characteristics. The aim is to collect eye movement information in a way that minimizes interference with personnel and to diagnose fatigue using an eye movement-fatigue evaluation model, thereby solving the problem that existing technologies cannot determine human fatigue in a timely and accurate manner.
[0005] To achieve the objective of this invention, a method for assessing the fatigue state of wiring in a junction box based on eye movement angular velocity characteristics is provided, comprising the following steps: S1: Obtain the eye gaze vector coordinate information of personnel during the wiring process of the junction box, and transform the eye gaze vector coordinate into an eye movement-fatigue analytical model of the angular velocity and extraocular muscle force state in the three orthogonal planes of the horizontal plane, sagittal plane and coronal plane. S2: Using the above eye movement-fatigue analytical model, the gaze vector is calculated to obtain the time-frequency dynamic characteristics of the eyeball angular velocity and the corresponding extraocular muscle exertion state on three orthogonal planes, and two special feature indicators are selected from them for fatigue evaluation. S3: Using the two special characteristic indicators mentioned above for fatigue evaluation, determine whether the operator of the wiring board has abducens nerve fatigue, oculomotor nerve fatigue and trochlear nerve fatigue, and then comprehensively judge the fatigue status of the personnel.
[0006] Furthermore, the eye gaze vector coordinate information acquisition device can be any one of MR (Mixed Reality) head-mounted glasses, an all-in-one head-mounted display device, or other virtual space head-mounted display devices. Preferably, the equivalent sampling frequency range for collecting eye movement data in virtual space is 10-50 Hz. More preferably, the equivalent eye movement sampling frequency range for using MR head-mounted glasses is 20-30 Hz.
[0007] The reason for choosing MR (Mixed Reality) headsets as the eye-tracking data sensing device is that, compared to other devices such as eye trackers, MR headsets cause less interference to the operator during the wiring process, and the acquired eye-tracking data is more accurate. According to relevant research, the human eye's reaction time to gaze shifts is generally over 100ms. Furthermore, to ensure that the accuracy of eye-tracking data does not decrease due to excessive load on the built-in processor caused by high sampling frequencies, leading to fluctuations in the frame rate, the equivalent eye-tracking sampling frequency range of the MR headset is preferably set at 20-30Hz.
[0008] In practical applications, MR headsets are used to acquire the eye-tracking vector coordinates of personnel during wiring operations on a junction box. Before data acquisition, the initial operating environment of the MR headset needs to be set up in advance. Based on the MR headset platform development tools, an eye movement information acquisition and recording program is edited and the eye movement information file is stored in the memory of the MR headset. At the same time, an interactive interface is created within the MR headset, enabling the operator to accurately and controllably start the acquisition and recording program and completely collect the eye-tracking vector coordinates throughout the entire process.
[0009] Furthermore, the eye movement-fatigue diagnostic model that associates the gaze vector with fatigue includes a static coordinate system eye gaze vector-three-plane coupling angle model, an eye three-plane coupling angle-extraocular muscle force model, and an eye movement dynamic feature quantity-fatigue relationship model.
[0010] Furthermore, the eye-viewing vector-three-plane coupling angle model in the proposed eye-fatigue diagnostic model is as follows:
[0011] in, and For the sensor in the first and The instantaneous value of the operator's three-dimensional gaze vector obtained at the +1st sampling; In static coordinate system Transformed by rotation in three orthogonal planes: horizontal, sagittal, and coronal. The rotation matrix; for Transform into The angle of rotation about the longitudinal axis on the horizontal plane. for Transform into The angle of rotation about the transverse axis in the sagittal plane. for Transform into The angle of rotation about the sagittal axis in the coronal plane; specified , and The range of values is .
[0012] This yields discrete sequences of angular velocities over time within three orthogonal planes during the eye movement process in the practitioner. , , ,in =0, 1, 2…, s, where s is the length of the collected eye-tracking information file.
[0013] Furthermore, the specific model of the three-plane coupling angle of the eyeball and the extraocular muscle exertion in the proposed eye movement-fatigue diagnostic model is as follows:
[0014] in, For the mass of a single eyeball, The radius of the eyeball is approximately the radius of a sphere. , indicating the sensor number The rotational angular velocity of the eyeball in the horizontal plane during the second sampling; similarly, , indicating the sensor number The rotational angular velocity of the eyeball in the sagittal plane during the second sampling; , indicating the sensor number The rotational angular velocity of the eyeball in the coronal plane during the second sampling. , representing the sensor number The relative position of the eyeball in the horizontal plane to the primary eye position (i.e., the position of the eyeball when looking forward horizontally from the center of the orbit) during the second sampling. and Similarly, it can be deduced that when the eyeball rotates from the primary position towards the nose in the horizontal plane, When the value is negative, and the object rotates towards the temple, It is positive. Similarly, it is stipulated that when the eyeball rotates from the primary position towards the frontal side in the sagittal plane, When the value is negative, and the rotation is towards the mouth and nose, It is positive; when the eyeball rotates from the primary position towards the temple in the coronal plane, When the value is negative, and the rotation is towards the nose, It is positive. Furthermore, it is defined that the right eyeball decomposes into rotational movements in three orthogonal planes: the horizontal plane, the sagittal plane, and the coronal plane. On a horizontal plane, the direction of rotation of the right eyeball toward the nose (inward rotation) is considered negative, and the direction of rotation toward the temple (outward rotation) is considered positive. In the sagittal plane, the direction of rotation of the right eyeball toward the forehead (upward) is considered negative, and the direction of rotation toward the mouth and nose (downward) is considered positive. On the coronal plane, the direction of rotation of the right eyeball toward the temple (external rotation) is considered negative, and the direction of rotation toward the nose (internal rotation) is considered positive.
[0015] When the ocular three-plane coupling angle-extraocular muscle force model is used as the research object, , and All refer to the exertion of the medial and lateral rectus muscles, superior and inferior rectus muscles, and superior and inferior oblique muscles of the right eyeball (when the left eyeball is taken as the research object, it represents the exertion of the medial and lateral rectus muscles, superior and inferior rectus muscles, and superior and inferior oblique muscles of the left eyeball); when calculated at two certain time points... A positive result indicates that during that time period, in the pair of extraocular muscles (medial and lateral rectus), the lateral rectus contracts to exert force on the eyeball while the medial rectus relaxes. When the calculated value... A negative value indicates that during that period, the medial rectus muscle contracts and exerts force on the eyeball while the lateral rectus muscle relaxes. Similarly, The corresponding superior and inferior rectus muscles and The force exertion of the corresponding superior and inferior oblique muscles can be deduced accordingly.
[0016] Furthermore, the eye-fatigue diagnostic model uses two special characteristic indicators for fatigue evaluation: the median frequency of the eyeball angular velocity power spectrum and the integral mean of the extraocular muscle force. At the same time, the eye-fatigue diagnostic model requires that the eyeball be in the first eye position as the initial state of the operator's eyeball position.
[0017] Furthermore, the comprehensive evaluation matrix for fatigue is as follows:
[0018] In other words, if a practitioner experiences any one of the following types of fatigue during the skill-learning process: abducens nerve fatigue, oculomotor nerve fatigue, or trochlear nerve fatigue, it is considered that the practitioner is experiencing fatigue.
[0019] Furthermore, the criteria for evaluating abducens nerve fatigue in wiring operators using two specific characteristic indicators for fatigue assessment—the median frequency of the eyeball angular velocity power spectrum and the integral mean of extraocular muscle exertion—are that any one of the following must be met: (7) (8) In the formula, To practically determine the median frequency of the power spectrum of the human eyeball's angular velocity in the horizontal plane. The median frequency is the critical fatigue value. This represents the decision margin for the median frequency. This represents the average integral of the forces exerted by the medial and lateral rectus muscles of the eyeball during the practical exercise. The fatigue threshold is the average integral of the force exerted by the extraocular muscles. This represents the decision margin for the integral mean.
[0020] The standard for evaluating whether a wiring operator experiences oculomotor fatigue is to meet any one of the following criteria: the median frequency of the ocular angular velocity power spectrum and the integral mean of extraocular muscle exertion, using two specific characteristic indicators for fatigue assessment: the median frequency of the ocular angular velocity power spectrum and the integral mean of extraocular muscle exertion. (9) (10) In the formula, To practically determine the median frequency of the power spectrum of the human eyeball's angular velocity in the sagittal plane, This represents the average integral of the forces exerted by the superior and inferior rectus muscles of the eyeball in the practitioner.
[0021] The criteria for evaluating whether a wiring operator experiences pulley-like neurological fatigue are met using two specific characteristic indicators for fatigue assessment: the median frequency of the eyeball angular velocity power spectrum and the integral mean of extraocular muscle exertion. This criterion is that any one of the following must be satisfied: (11) (12) In the formula, To practically determine the median frequency of the power spectrum of the human eye's angular velocity in the coronal plane, This represents the average integral of the force exerted by the superior and inferior oblique muscles of the eyeball in the practitioner.
[0022] Compared with the prior art, the present invention has at least the following beneficial effects: 1. Compared with sensing methods such as eye trackers, this invention uses any one of MR head-mounted glasses, integrated head-mounted display devices, and other virtual space head-mounted display devices to collect eye movement data, which can reduce objective interference to operators, simplify the data collection process, and improve the accuracy of raw eye movement data.
[0023] 2. This invention has the advantages of flexibility, simplicity and rapid learning. The entire process of data acquisition and online diagnosis only requires one person. Fatigue assessment can be quickly performed through the parameter values of the preset model. At the same time, it is also practical in the field of wiring of junction boxes.
[0024] 3. This invention simplifies the fatigue assessment process, reduces the subjective influence of the assessor and the assessment time, and can effectively improve the efficiency and accuracy of fatigue assessment. Attached Figure Description
[0025] Figure 1 A flowchart of a wiring fatigue state assessment method based on eye movement angular velocity characteristics is provided for an embodiment of the present invention.
[0026] Figure 2 This is a schematic diagram of the extraocular muscles of the right eyeball and the force exerted by the extraocular muscles and the spatial rotation of the eyeball in an embodiment of the present invention.
[0027] Figure 3 This is a schematic diagram of the HoloLens2 human-computer interaction interface and experimental site in an embodiment of the present invention.
[0028] Figure 4 This is a schematic diagram illustrating the difference in eye movement between a person in a fatigued and non-fatigue state in an embodiment of the present invention. Detailed Implementation
[0029] The present invention will be further described in detail below with reference to the embodiments and accompanying drawings, but the embodiments of the present invention are not limited thereto.
[0030] Please see Figure 1 The present invention provides a method for evaluating the fatigue state of wiring in a junction box based on eye movement angular velocity characteristics, comprising the following steps: S1: Obtain the eye gaze vector coordinate information of personnel during the wiring process of the junction box, and transform the eye gaze vector coordinate into an eye movement-fatigue diagnosis model based on the angular velocity and extraocular muscle force state in the three orthogonal planes of the horizontal, sagittal and coronal planes.
[0031] In some embodiments of the present invention, the practical training scenario is set as a simulated wiring experiment on a complex circuit board. The hardware devices involved include: MR headset and PC. The MR headset is used to collect the eye-tracking vector coordinate information of the operator during the wiring process and to facilitate human-computer interaction with the operator. The PC is used to receive the eye-tracking vector coordinate information, calculate and finally provide a diagnostic result using an eye movement-fatigue evaluation model. In some embodiments of this invention, the MR headset used is HoloLens2. Preparatory work before the experiment includes: creating a HoloLens2 interactive interface for data acquisition in Unity; adding collision entities and interaction logic to the interactive interface buttons; using MRTK (Mixed Reality Toolkit) to write a script program that calls the eye-tracking function of HoloLens2 and records eye gaze vectors at a set frequency (e.g., 25Hz); deploying this application to HoloLens2 via Visual Studio; and using a PC to write a script program in Matlab to convert the eye gaze vector file data from JSON format to Excel format for easy data retrieval in subsequent model calculations. The preparatory work involved here will not be elaborated upon further. It should be noted that in this embodiment, the experiment was conducted by the operator under conditions where their subjective fatigue level was considered to be fatigued.
[0032] like Figure 3 As shown, after adjusting the first eye position to the initial experimental posture of the eyeball, the operator can click the "get eye data" button in the interactive interface to start the wiring experiment. After completing the wiring experiment, click the "get eye data" button again to end the recording of eyeball line-of-sight vector data.
[0033] The above process is used to obtain eye gaze vector data. As shown in Table 1: Table 1
[0034] S2: The eye movement-fatigue diagnosis model is used to calculate the gaze vector, and the time-frequency dynamic characteristics of the eyeball angular velocity and the corresponding extraocular muscle exertion state on three orthogonal planes are obtained respectively. Two special feature indicators are selected from them for fatigue evaluation. The special feature indicators include the median frequency of the eyeball angular velocity power spectrum and the integral mean of the extraocular muscle exertion.
[0035] In this step, the eye movement-fatigue diagnosis model includes a static coordinate system eye-line vector-three-plane coupling angle model, an eye-three-plane coupling angle-extraocular muscle exertion model, and an eye movement dynamic feature quantity-fatigue relationship model, wherein: The specific eye-view vector-three-plane coupling angle model in the eye-fatigue diagnosis model is as follows:
[0036] in, and For the sensor in the first and The instantaneous value of the operator's three-dimensional gaze vector obtained at the +1st sampling; In static coordinate system Transformed by rotation in three orthogonal planes: horizontal, sagittal, and coronal. The rotation matrix; for Transform into The angle of rotation about the longitudinal axis on the horizontal plane. for Transform into The angle of rotation about the transverse axis in the sagittal plane. for Transform into The angle of rotation about the sagittal axis in the coronal plane. In some embodiments of the invention, , and The range of values is ; This allows us to obtain discrete sequences of angular velocities over time within three orthogonal planes during the eye movement process in the practitioner. , , ,in =0, 1, 2…, s, where s is the length of the collected eye-tracking information file; The specific model of the three-plane coupling angle of the eyeball and the force exerted by the extraocular muscles is as follows:
[0037] Where m is the mass of a single eyeball, and r is the approximate spherical radius of the eyeball. , indicating the sensor number The rotational angular velocity of the eyeball in the horizontal plane during the next sampling; , indicating the sensor number The rotational angular velocity of the eyeball in the sagittal plane during the second sampling; , indicating the sensor number The rotational angular velocity of the eyeball in the coronal plane during the second sampling. , representing the sensor number The relative position of the eyeball in the horizontal plane to the primary eye position (i.e., the position of the eyeball when looking forward horizontally from the center of the orbit) during the second sampling. , representing the sensor number The relative position of the eyeball in the sagittal plane to the first eye position during the second sampling; , representing the sensor number The relative position of the eyeball in the coronal plane to the primary eye position during the second sampling; it is defined that when the eyeball rotates from the primary eye position towards the nasal side in the horizontal plane, When the value is negative, and the object rotates towards the temple, It is positive. Similarly, it is stipulated that when the eyeball rotates from the primary position towards the frontal side in the sagittal plane, When the value is negative, and the rotation is towards the mouth and nose, It is positive; when the eyeball rotates from the primary position towards the temple in the coronal plane, When the value is negative, and the rotation is towards the nose, It is positive. Furthermore, it is defined that the right eyeball decomposes into rotational movements in three orthogonal planes: the horizontal plane, the sagittal plane, and the coronal plane. On a horizontal plane, the direction of rotation of the right eyeball toward the nose (inward rotation) is considered negative, and the direction of rotation toward the temple (outward rotation) is considered positive. In the sagittal plane, the direction of rotation of the right eyeball toward the forehead (upward) is considered negative, and the direction of rotation toward the mouth and nose (downward) is considered positive. On the coronal plane, the direction of rotation of the right eyeball toward the temple (external rotation) is considered negative, and the direction of rotation toward the nose (internal rotation) is considered positive.
[0038] The ocular three-plane coupling angle-extraocular muscle force model takes the right eyeball as the research object. , and All refer to the exertion of force by the medial and lateral rectus muscles, superior and inferior rectus muscles, and superior and inferior oblique muscles of the right eyeball; calculated at two specific moments. A positive result indicates that during that time period, in the pair of extraocular muscles (medial and lateral rectus), the lateral rectus contracts to exert force on the eyeball while the medial rectus relaxes. When the calculated value... A negative value indicates that during that time period, the medial rectus muscle contracts and exerts force on the eyeball while the lateral rectus muscle relaxes. Similarly, the values calculated between two time points... A positive result indicates that during that time period, in the pair of extraocular muscles (superior and inferior rectus), the inferior rectus muscle contracts and exerts force on the eyeball, while the superior rectus muscle relaxes. When the calculated value... A negative value indicates that the superior rectus muscle contracts and exerts force on the eyeball while the inferior rectus muscle relaxes during that time period; the result calculated between two time points. A positive result indicates that during that time period, in the pair of extraocular muscles (superior and inferior oblique), the superior oblique muscle contracts and exerts force on the eyeball, while the inferior oblique muscle relaxes. When the calculated value... A negative value indicates that during that period, the inferior oblique muscle contracts, exerting force on the eyeball, while the superior oblique muscle relaxes. (If it's the left eyeball,) , and (Refers to the exertion of force by the medial and lateral rectus muscles, superior and inferior rectus muscles, and superior and inferior oblique muscles of the left eyeball) Specifically, in some embodiments of the present invention, Substituting these values into the aforementioned eye-viewing vector-three-plane coupled angle model, we obtain a discrete sequence of the angles changing over time on the three orthogonal planes during the eye movement process of the operator. , , As shown in Table 2: Table 2
[0039] In some embodiments of the present invention, the eye-tracking equivalent sampling frequency is set to 25 Hz, thus obtaining 40ms This refers to the sampling interval between every two eye-tracking data points, which is a discrete sequence of angles on three orthogonal planes during the operator's eye movement process. , , and , , The discrete sequences of angular velocities in three orthogonal planes were obtained during the eye movement process of the operator. , , The angle between the aforementioned eyeball and the first eye position in the horizontal plane With three discrete sequences of angular velocities , , Substituting this into the above-described three-plane coupling angle-extraocular muscle force model; where, in this embodiment, m is taken as 0.007 kg and r as 0.012 m. A discrete sequence of the changes in the force exerted by the three pairs of extraocular muscles (medial and lateral rectus muscles, superior and inferior rectus muscles, and superior and inferior oblique muscles) over time during eye movements in the operator is obtained. , and As shown in Table 3: Table 3
[0040] S3: Using the two special characteristic indicators used for fatigue evaluation, determine whether the operator of the wiring board has abducens nerve fatigue, oculomotor nerve fatigue and trochlear nerve fatigue, respectively, and then comprehensively judge the fatigue status of the personnel.
[0041] Furthermore, two specific characteristic indicators for fatigue evaluation were selected: the median frequency of the ocular angular velocity power spectrum and the integral mean of extraocular muscle exertion. The calculation of the median frequency and integral mean of the discrete sequence power spectrum will not be elaborated upon here. In this embodiment, the calculation results of the median frequency of the ocular angular velocity power spectrum and the integral mean of extraocular muscle exertion are retained to two decimal places, as shown in Tables 4 and 5.
[0042] Table 4
[0043] Table 5
[0044] Furthermore, in this embodiment, two specific characteristic indicators for fatigue evaluation are used: the median frequency of the eyeball angular velocity power spectrum and the integral mean of extraocular muscle exertion. The standard for evaluating the abducens nerve fatigue of the wiring operator is to meet any one of the following criteria: (6) (7) In the formula, To practically determine the median frequency of the power spectrum of the human eye's angular velocity in the horizontal plane, this embodiment... 2.42Hz The fatigue critical value is the median frequency; in this embodiment, it is taken as... 5.4Hz As the decision margin for the median frequency, in this embodiment, we take... 10%; In this embodiment, the integral mean of the forces exerted by the medial and lateral rectus muscles of the human eye is used as the experimental parameter. 1.14mN The fatigue threshold value is the average integral of the force exerted by the extraocular muscles. In this embodiment, it is taken as... 2mN, As the decision margin for the integral mean, in this embodiment, we take... 10%.
[0045] Substituting the aforementioned judgment criteria, it can be concluded that in this embodiment, the operator of the wiring board experiences abducens-type fatigue.
[0046] In this embodiment, two special characteristic indicators for fatigue evaluation are used: the median frequency of the eyeball angular velocity power spectrum and the integral mean of extraocular muscle exertion. The standard for evaluating whether a wiring operator has oculomotor nerve fatigue is that any one of the following must be met: (8) (9) In the formula, To practically determine the median frequency of the power spectrum of the human eye's angular velocity in the sagittal plane, this embodiment... 1.33Hz In this embodiment, the integral average of the forces exerted by the superior and inferior rectus muscles of the human eye is used. 0.28mN.
[0047] Substituting the aforementioned judgment criteria, it can be concluded that in this embodiment, the operator of the wiring board experiences eye-movement nerve fatigue.
[0048] In this embodiment, two special characteristic indicators for fatigue evaluation are used: the median frequency of the eyeball angular velocity power spectrum and the integral mean of extraocular muscle exertion. The standard for evaluating the presence of pulley nerve fatigue in wiring operators is to meet any one of the following criteria: (10) (11) In the formula, To practically determine the median frequency of the power spectrum of the human eyeball's angular velocity in the coronal plane, this embodiment... 2.17Hz In this embodiment, the integral average of the forces exerted by the superior and inferior oblique muscles of the human eye is used to measure the force applied. 0.20mN.
[0049] Substituting the aforementioned judgment criteria, it can be concluded that in this embodiment, the operator of the wiring board experiences pulley-like nerve fatigue.
[0050] Furthermore, the eye-movement dynamic feature quantity-fatigue relationship model is based on an evaluation result matrix that comprehensively evaluates fatigue. The evaluation result matrix is as follows:
[0051] Based on the aforementioned criteria, it can be concluded that in this embodiment, the operator experienced fatigue, which is consistent with the operator's subjective feelings before conducting the practical experiment.
[0052] In another embodiment of the present invention, the method steps of the provided method for evaluating the fatigue state of wiring board based on eye movement angular velocity characteristics are the same as those in the foregoing embodiments, and will not be repeated here.
[0053] In the specific implementation of this embodiment, the on-site setup, hardware facilities, and experimental pre-work are the same as in the aforementioned embodiments, and will not be repeated here.
[0054] It should be noted that in this embodiment, the experiment was conducted by the operator in a state where he subjectively assessed his own fatigue state as non-fatigue.
[0055] After adjusting the first eye position to the initial experimental posture of the eyeball, the operator can click the "get eyedata" button in the interactive interface to start the wiring experiment. After completing the wiring experiment, click the "get eye data" button again to end the recording of eyeball line-of-sight vector data.
[0056] The above process is used to obtain eye gaze vector data. As shown in Table 6: Table 6
[0057] Will Substituting these values into the aforementioned eye-viewing vector-three-plane coupled angle model, we obtain a discrete sequence of angles changing over time on the three orthogonal planes during the eye movement process of the operator. , , As shown in Table 7: Table 7
[0058] Furthermore, in this embodiment, the eye-tracking equivalent sampling frequency is set to 25 Hz, therefore, we can obtain... 40ms, a discrete sequence of angles on three orthogonal planes during the eye movement process of the operator. , , and , , The discrete sequences of angular velocities in three orthogonal planes were obtained during the eye movement process of the operator. , , The angle between the aforementioned eyeball and the first eye position in the horizontal plane With three discrete sequences of angular velocities , , Substituting this into the above-described three-plane coupling angle-extraocular muscle force model; where, in this embodiment, m is taken as 0.007 kg and r as 0.012 m. A discrete sequence of the changes in the force exerted by the three pairs of extraocular muscles (medial and lateral rectus muscles, superior and inferior rectus muscles, and superior and inferior oblique muscles) over time during eye movements in the operator is obtained. , and As shown in Table 8: Table 8
[0059] Furthermore, two specific characteristic indicators for fatigue evaluation are selected: the median frequency of the ocular angular velocity power spectrum and the integral mean of extraocular muscle exertion. The calculation of the median frequency and integral mean of the discrete sequence power spectrum will not be elaborated here. In this embodiment, the calculation results of the median frequency of the ocular angular velocity power spectrum and the integral mean of extraocular muscle exertion are retained to two decimal places, as shown in Tables 9 and 10.
[0060] Table 9
[0061] Table 10
[0062] Furthermore, in this embodiment, two specific characteristic indicators for fatigue evaluation are used: the median frequency of the eyeball angular velocity power spectrum and the integral mean of extraocular muscle exertion. The standard for evaluating the abducens nerve fatigue of the wiring operator is to meet any one of the following criteria: (6) (7) In the formula, To practically determine the median frequency of the power spectrum of the human eye's angular velocity in the horizontal plane, this embodiment... 5.57Hz The fatigue critical value is the median frequency; in this embodiment, it is taken as... 5.4Hz As the decision margin for the median frequency, in this embodiment, we take... 10%; In this embodiment, the integral mean of the forces exerted by the medial and lateral rectus muscles of the human eye is used as the experimental parameter. 3.62mN The fatigue threshold value is the average integral of the force exerted by the extraocular muscles. In this embodiment, it is taken as... 2mN, As the decision margin for the integral mean, in this embodiment, we take... 10%.
[0063] Substituting the aforementioned judgment criteria, we can conclude that in this embodiment, the operator of the wiring board does not experience abducens-related nerve fatigue.
[0064] In this embodiment, two special characteristic indicators for fatigue evaluation are used: the median frequency of the eyeball angular velocity power spectrum and the integral mean of extraocular muscle exertion. The standard for evaluating whether a wiring operator has oculomotor nerve fatigue is that any one of the following must be met: (8) (9) In the formula, To practically determine the median frequency of the power spectrum of the human eye's angular velocity in the sagittal plane, this embodiment... 5.13Hz In this embodiment, the integral average of the forces exerted by the superior and inferior rectus muscles of the human eye is used. 4.13mN.
[0065] Substituting the aforementioned judgment criteria, it can be concluded that in this embodiment, the operator of the wiring board does not experience eye-movement nerve fatigue.
[0066] In this embodiment, two special characteristic indicators for fatigue evaluation are used: the median frequency of the eyeball angular velocity power spectrum and the integral mean of extraocular muscle exertion. The standard for evaluating the presence of pulley nerve fatigue in wiring operators is to meet any one of the following criteria: (10) (11) In the formula, To practically determine the median frequency of the power spectrum of the human eyeball's angular velocity in the coronal plane, this embodiment... 5.66Hz In this embodiment, the integral average of the forces exerted by the superior and inferior oblique muscles of the human eye is used to measure the force applied. 4.23mN.
[0067] Substituting the aforementioned judgment criteria, it can be concluded that in this embodiment, the operator of the wiring board does not experience pulley-like neural fatigue.
[0068] Furthermore, in this embodiment, the evaluation result matrix based on the comprehensive fatigue assessment is as follows:
[0069] Based on the aforementioned criteria, it can be concluded that in this embodiment, the operator did not experience fatigue, which is consistent with the operator's subjective feelings before conducting the practical experiment.
[0070] It should be noted that, in this embodiment, with the model and parameters preset on the PC, it only takes a few minutes from obtaining the three-dimensional data of the operator's eye gaze vector to obtaining the diagnostic result.
[0071] In summary, a fatigue state assessment method for wiring boards based on eye movement angular velocity characteristics has the advantages of simplifying the data acquisition process, simplifying the fatigue diagnosis process, improving the efficiency and accuracy of fatigue diagnosis, and being flexible, convenient, and easy to learn in the field of fatigue diagnosis.
[0072] The above are preferred embodiments of the present invention, but the embodiments of the present invention are not limited to the above content. Any changes, modifications, substitutions, combinations, or simplifications made without departing from the essence and principle of the present invention shall be considered equivalent substitutions and shall be included within the protection scope of the present invention.
Claims
1. A method for assessing the fatigue state of wiring in a junction box based on eye-tracking angular velocity characteristics, characterized in that, Includes the following steps: S1: Obtain the eye gaze vector coordinate information of personnel during the wiring process of the junction box, and use the eye movement-fatigue diagnosis model to transform the eye gaze vector coordinate into the angular velocity and extraocular muscle force state in the three orthogonal planes of the horizontal plane, sagittal plane and coronal plane. S2: The eye movement-fatigue diagnosis model is used to calculate the gaze vector, and the time-frequency dynamic characteristics of the eyeball angular velocity and the corresponding extraocular muscle exertion state on three orthogonal planes are obtained respectively. Two special feature indicators are selected from them for fatigue evaluation. S3: Using the two special characteristic indicators mentioned above for fatigue evaluation, determine whether the operator of the wiring board has abducens nerve fatigue, oculomotor nerve fatigue and trochlear nerve fatigue, and then make a comprehensive diagnosis of the operator's fatigue status. Among them, the eye movement-fatigue diagnosis model that associates the gaze vector with fatigue includes the eye gaze vector-three-plane coupling angle model in static coordinate system, the eye three-plane coupling angle-extraocular muscle force model and the eye movement dynamic feature quantity-fatigue relationship model; The eye-view vector-three-plane coupling angle model is as follows: in, and For the sensor in the first and The instantaneous value of the operator's three-dimensional gaze vector obtained at the +1st sampling; In static coordinate system Transformed by rotation in three orthogonal planes: horizontal, sagittal, and coronal. rotation matrix; for Transform into The angle of rotation about the longitudinal axis on the horizontal plane. for Transform into The angle of rotation about the transverse axis in the sagittal plane. for Transform into The angle of rotation about the sagittal axis in the coronal plane; The ocular three-plane coupling angle-extraocular muscle force model is as follows: in, For the mass of a single eyeball, The radius of the eyeball is approximately the radius of a sphere. , indicating the sensor number The rotational angular velocity of the eyeball in the horizontal plane during the next sampling; , indicating the sensor number The rotational angular velocity of the eyeball in the sagittal plane during the next sampling; , indicating the sensor number The rotational angular velocity of the eyeball in the coronal plane during the second sampling; , representing the sensor number The relative position of the eyeball in the horizontal plane to the primary eye position during the second sampling. , representing the sensor number The relative position of the eyeball in the sagittal plane to the first eye position during the second sampling; , representing the sensor number The relative position of the eyeball in the coronal plane to the primary eye position during the second sampling; , and The exertion of force by the medial and lateral rectus muscles, the superior and inferior rectus muscles, and the superior and inferior oblique muscles of the eyeball; The eye movement dynamic feature quantity-fatigue relationship model is an evaluation matrix for comprehensively evaluating fatigue. The evaluation matrix is as follows: That is, if the operator experiences any one of the following types of fatigue during the skill process: abducens nerve fatigue, oculomotor nerve fatigue, or trochlear nerve fatigue, it is considered that the operator is experiencing fatigue. The two special characteristic indicators used in the eye-tracking fatigue diagnosis model for fatigue evaluation are the median frequency of the eyeball angular velocity power spectrum and the integral mean of the extraocular muscle force. At the same time, the eye-tracking fatigue diagnosis model requires the eyeball to be in the first eye position as the initial state of the operator's eyeball position.
2. The method for evaluating the fatigue state of wiring board based on eye movement angular velocity characteristics according to claim 1, characterized in that: The criteria for evaluating abducens nerve fatigue in wiring operators using the median frequency of the ocular angular velocity power spectrum and the integral mean of extraocular muscle exertion are: meeting any one of the following conditions. （7） （8） In the formula, To practically determine the median frequency of the power spectrum of the human eyeball's angular velocity in the horizontal plane. The median frequency is the critical fatigue value. This represents the decision margin for the median frequency. This represents the average integral of the forces exerted by the medial and lateral rectus muscles of the eyeball during the practical exercise. The fatigue threshold is the average integral of the force exerted by the extraocular muscles. The decision margin for the integral mean; The criterion for evaluating whether a wiring operator has oculomotor nerve fatigue, based on the median frequency of the ocular angular velocity power spectrum and the integral mean of extraocular muscle exertion, is to meet any one of the following: （9） （10） In the formula, To practically determine the median frequency of the power spectrum of the human eyeball's angular velocity in the sagittal plane, This represents the average integral of the forces exerted by the superior and inferior rectus muscles of the eyeball in the practitioner. The criterion for evaluating whether a wiring operator exhibits pulley-like neurological fatigue, based on the median frequency of the eyeball angular velocity power spectrum and the integral mean of extraocular muscle exertion, is that any one of the following must be met: （11） （12） In the formula, To practically determine the median frequency of the power spectrum of the human eye's angular velocity in the coronal plane, This represents the average integral of the force exerted by the superior and inferior oblique muscles of the eyeball in the practitioner.
3. The method for assessing the fatigue state of wiring board based on eye movement angular velocity characteristics according to claim 1, characterized in that, The eye gaze vector coordinate information acquisition device can be any one of MR head-mounted glasses, an integrated head-mounted display device, or other virtual space head-mounted display devices.
4. The method for evaluating the fatigue state of wiring board based on eye movement angular velocity characteristics according to claim 3, characterized in that, The equivalent sampling frequency range for collecting eye-tracking data in virtual space is 10~50 Hz.
5. A method for assessing the fatigue state of wiring board based on eye movement angular velocity characteristics according to any one of claims 1-4, characterized in that, The method described herein is applicable to practitioners who subjectively assess their own fatigue state as either fatigued or not fatigued.