Evaluation method and device based on engineering vehicle driver state monitoring

Abstract

The invention relates to the technical field of data processing, and discloses an evaluation method and device based on engineering vehicle driver state monitoring, and the method comprises the steps: determining NVH subjective evaluation content for an engineering vehicle and driver information of a driver, generating a driving test task for the driver according to the NVH subjective evaluation content and the driver information, and transmitting the driving test task to the engineering vehicle. And in the process that the driver drives the engineering vehicle to complete the driving test task, determining a driving test score corresponding to the driver according to the driving information of the driver, and judging whether the driver meets an NVH subjective evaluation condition corresponding to the engineering vehicle according to the driving test score. Visibly, the accuracy and reliability of determining the driving test score of the driver can be improved, the accuracy of judging whether the driver meets the subjective evaluation condition is further improved, the situation that the NVH subjective evaluation is affected by the abnormal state of the driver is reduced, and the driving test score of the driver is determined more accurately and reliably. And the efficiency, the standardization degree, the accuracy and the reliability of the NVH subjective evaluation of the engineering vehicle are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to an evaluation method and device based on engineering vehicle driver status monitoring. Background Art

[0002] In the field of engineering machinery, especially in the construction process of heavy engineering equipment such as excavators, the issue of noise and vibration control (NVH) has become increasingly important. As the core equipment on the construction site, the noise and vibration generated during the operation of the excavator may not only pose a potential threat to the health of the operator, but also have an adverse effect on the overall performance and service life of the equipment. Therefore, improving the NVH performance of the excavator and ensuring that the operator can work in a comfortable and safe environment has become an important direction for the current research and development of engineering machinery.

[0003] However, in the process of evaluating NVH performance, judgment is traditionally based on the driver's subjective feelings. However, this method may be affected by factors such as the driver's fatigue state, emotional state, age, gender, health status, and work experience, which may interfere with the subjective evaluation of NVH performance to a certain extent, resulting in a decrease in the accuracy of subjective NVH evaluation of engineering vehicles. Therefore, it is particularly important to propose a technical solution that can improve the accuracy and reliability of subjective NVH evaluation of engineering vehicles. Summary of the invention

[0004] The present invention provides an evaluation method and device based on engineering vehicle driver status monitoring, which can be beneficial to improving the accuracy and reliability of NVH subjective evaluation of engineering vehicles.

[0005] In order to solve the above technical problems, the first aspect of the present invention discloses an evaluation method based on engineering vehicle driver status monitoring, the method comprising:

[0006] Determining NVH subjective evaluation content for the engineering vehicle and driver information of the driver, wherein the NVH subjective evaluation content includes at least one of idle evaluation content, driving evaluation content, and operation evaluation content;

[0007] Generate at least one driving test task for the driver according to the NVH subjective evaluation content and the driver information, and collect the driver's driving information when the driver drives the engineering vehicle to complete each driving test task, wherein the driving information includes driving video information and driving operation information;

[0008] A driving test score corresponding to the driver is determined according to the driving information, and whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle is judged according to the driving test score.

[0009] A second aspect of the present invention discloses an evaluation device based on monitoring the state of an engineering vehicle driver, the device comprising:

[0010] A determination module, used to determine NVH subjective evaluation content for the engineering vehicle and driver information of the driver, wherein the NVH subjective evaluation content includes at least one of idle evaluation content, driving evaluation content and operation evaluation content;

[0011] A generating module, configured to generate at least one driving test task for the driver according to the NVH subjective evaluation content and the driver information, and to collect the driver's driving information while the driver drives the engineering vehicle to complete each driving test task, wherein the driving information includes driving video information and driving operation information;

[0012] The determination module is further used to determine a driving test score corresponding to the driver according to the driving information;

[0013] A judgment module is used to judge whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle according to the driving test score.

[0014] The third aspect of the present invention discloses another evaluation device based on monitoring the state of an engineering vehicle driver, the device comprising:

[0015] A memory storing executable program code;

[0016] a processor coupled to the memory;

[0017] The processor calls the executable program code stored in the memory to execute the evaluation method based on engineering vehicle driver status monitoring disclosed in the first aspect of the present invention.

[0018] The fourth aspect of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute the evaluation method based on engineering vehicle driver status monitoring disclosed in the first aspect of the present invention.

[0019] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0020] In an embodiment of the present invention, the NVH subjective evaluation content for the engineering vehicle and the driver's driver information are determined, and at least one driving test task for the driver is generated based on the NVH subjective evaluation content and the driver information, and in the process of the driver driving the engineering vehicle to complete each driving test task, the driver's driving information is collected, and the driver's corresponding driving test score is determined based on the driving information, and the driver is judged based on the driving test score whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle. It can be seen that the implementation of the present invention can improve the real-time monitoring capability of the driver, improve the accuracy and reliability of determining the driver's driving test score, and then improve the accuracy of judging whether the driver meets the subjective evaluation conditions, reduce the occurrence of situations where the NVH subjective evaluation is affected by the abnormal state of the driver, improve the efficiency and standardization of the NVH subjective evaluation of engineering vehicles, and improve the accuracy and reliability of the NVH subjective evaluation of engineering vehicles. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 It is a flow chart of an evaluation method based on engineering vehicle driver status monitoring disclosed in an embodiment of the present invention;

[0023] Figure 2 It is a flow chart of another evaluation method based on engineering vehicle driver status monitoring disclosed in an embodiment of the present invention;

[0024] Figure 3 It is a structural schematic diagram of an evaluation device based on engineering vehicle driver status monitoring disclosed in an embodiment of the present invention;

[0025] Figure 4 It is a structural schematic diagram of another evaluation device based on engineering vehicle driver status monitoring disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, device, product or end including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or ends.

[0028] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0029] The present invention discloses an evaluation method and device based on the monitoring of the driver state of an engineering vehicle, which can improve the real-time monitoring capability of the driver, improve the accuracy and reliability of determining the driver's driving test score, and further improve the accuracy of judging whether the driver meets the subjective evaluation conditions, reduce the occurrence of the situation where the NVH subjective evaluation is affected by the abnormal state of the driver, improve the efficiency and standardization of the NVH subjective evaluation of engineering vehicles, and improve the accuracy and reliability of the NVH subjective evaluation of engineering vehicles. The following are detailed descriptions.

[0030] Embodiment 1

[0031] See also Figure 1 , Figure 1 : is a flow chart of an evaluation method based on engineering vehicle driver status monitoring disclosed in an embodiment of the present invention. Figure 1 The evaluation method based on the state monitoring of the engineering vehicle driver described can be applied to the evaluation device based on the state monitoring of the engineering vehicle driver, wherein the evaluation device based on the state monitoring of the engineering vehicle driver may include an intelligent device for scoring the engineering vehicle driver, and the intelligent device may include any one of a data acquisition device, an intelligent server or an intelligent platform, and the data acquisition device may include at least one of a camera, a microphone and a sensor, and the intelligent server may include a local server or a cloud server, which is not limited in the embodiments of the present invention. Figure 1 As shown, the evaluation method based on engineering vehicle driver status monitoring may include the following operations:

[0032] 101. Determine the NVH subjective evaluation content for engineering vehicles and the driver's information.

[0033] In an embodiment of the present invention, optionally, the engineering vehicle may include one or more of an engineering transport vehicle, a crane, an excavator, a bulldozer, a road roller, a loader, an engineering rescue vehicle, a trailer, etc., the NVH subjective evaluation content may include at least one of an idle evaluation content, a driving evaluation content, and an operation evaluation content, etc., and the driver's driver information may include the driver's physiological health information and the driver's historical driving information for the engineering vehicle, which is not limited by the present invention.

[0034] 102. Generate at least one driving test task for the driver based on the NVH subjective evaluation content and the driver information, and collect the driver's driving information while the driver drives the engineering vehicle to complete each driving test task.

[0035] In an embodiment of the present invention, optionally, at least one driving test task for the driver can be used to perform an engineering vehicle driving test on the driver to determine whether the driver is currently suitable for NVH subjective evaluation of the engineering vehicle. The at least one driving test task may include one or more combinations of idle start, gravel rotation, no-load simulated excavation, bumpy road walking, stone stripping, etc. The driver's driving information may include driving video information and driving operation information. Specifically, in the process of the driver driving the engineering vehicle to complete each driving test task, the driver's driving video information can be collected by a camera and / or microphone arranged inside or outside the engineering vehicle, and the driver's driving operation information can be collected by a variety of sensors arranged inside or outside the engineering vehicle. The various sensors may include but are not limited to pressure sensors, speed sensors, rotation speed sensors, displacement sensors, etc., which are not limited by the present invention.

[0036] 103. Determine the driving test score corresponding to the driver based on the driving information, and judge whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle based on the driving test score.

[0037] In an embodiment of the present invention, optionally, a driving test score corresponding to the driver can be determined based on driving information, and whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle can be judged based on the driving test score. When the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle, it is determined that the driver is capable of performing NVH subjective evaluation on the engineering vehicle, and the present invention does not limit this.

[0038] It can be seen that the implementation Figure 1The described evaluation method based on engineering vehicle driver status monitoring can determine the NVH subjective evaluation content for the engineering vehicle and the driver's driver information, generate at least one driving test task for the driver based on the NVH subjective evaluation content and the driver information, and collect the driver's driving information while the driver is driving the engineering vehicle to complete each driving test task, determine the driver's corresponding driving test score based on the driving information, and judge whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle based on the driving test score. This method can improve the real-time monitoring capability of the driver, improve the accuracy and reliability of determining the driver's driving test score, and further improve the accuracy of judging whether the driver meets the subjective evaluation conditions, reduce the occurrence of situations where the NVH subjective evaluation is affected by the abnormal state of the driver, improve the efficiency and standardization of the NVH subjective evaluation of engineering vehicles, and improve the accuracy and reliability of the NVH subjective evaluation of engineering vehicles.

[0039] Embodiment 2

[0040] See also Figure 2 , Figure 2 : is a flow chart of an evaluation method based on engineering vehicle driver status monitoring disclosed in an embodiment of the present invention. Figure 2 The evaluation method based on the state monitoring of the engineering vehicle driver described can be applied to the evaluation device based on the state monitoring of the engineering vehicle driver, wherein the evaluation device based on the state monitoring of the engineering vehicle driver may include an intelligent device for scoring the engineering vehicle driver, and the intelligent device may include any one of a data acquisition device, an intelligent server or an intelligent platform, and the data acquisition device may include at least one of a camera, a microphone and a sensor, and the intelligent server may include a local server or a cloud server, which is not limited in the embodiments of the present invention. Figure 2 As shown, the evaluation method based on engineering vehicle driver status monitoring may include the following operations:

[0041] 201. Determine the NVH subjective evaluation content for engineering vehicles and the driver's information.

[0042] 202. Generate at least one driving test task for the driver based on the NVH subjective evaluation content and the driver information, and collect the driver's driving information while the driver drives the engineering vehicle to complete each driving test task.

[0043] 203. Determine the driver's facial information and body movement information based on the driving video information, and determine the driver's state information and line of sight information based on the facial information.

[0044] In an embodiment of the present invention, optionally, driving video information can be used to determine the driver's facial information and body movement information, wherein the facial information may include the driver's facial expression information, the body movement information may include at least one of the driver's hand movement information, footstep movement information, body movement information, etc., the driver's status information may include the driver's fatigue status information and emotional status information, and the driver's line of sight information may include the driver's line of sight placement information, which is not limited by the present invention.

[0045] 204. Determine the driver's operating action information according to the driving operation information and the body movement information.

[0046] In an embodiment of the present invention, optionally, the driver's operating action information may include the driver's operating action force information and the operating action execution time information. The driver's operating action force information may include the driver's operating action execution force, the operating action execution amplitude, etc. The driver's operating action execution time information may include the driver's operating action execution time, the operating action execution duration, etc., which is not limited by the present invention.

[0047] 205. Determine at least one task key point corresponding to each driving test task and a key point instruction corresponding to each task key point.

[0048] In an embodiment of the present invention, optionally, at least one task key point corresponding to each driving test task may represent a key step or key process in the driving test task, for example, one or more combinations of vehicle inspection steps, gear throttle handle adjustment steps, ignition steps, idle adjustment steps, etc. in an idle start project for an engineering vehicle. The key point instructions corresponding to each task key point may include an operation instruction corresponding to the task key point, and the driver performs a corresponding operation according to the operation instruction, which is not limited by the present invention.

[0049] 206. Determine the driver's score information corresponding to each key point of the task based on the driver's status information, line of sight information, operation action information, and key point instructions corresponding to each key point of the task, and determine the driver's corresponding driving test score based on the driver's score information corresponding to each key point of the task.

[0050] In an embodiment of the present invention, optionally, the scoring information corresponding to the driver at each key point of the task may include the driver's state score and operation score corresponding to each key point of the task, and the operation score may include the driver's line of sight score and operation action score corresponding to each key point of the task, which is not limited by the present invention.

[0051] 207. Determine whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle based on the driving test score.

[0052] In the embodiment of the present invention, for other descriptions of step 201, step 202 and step 207, please refer to the detailed description of step 101 to step 103 in the first embodiment, and the embodiment of the present invention will not be repeated.

[0053] It can be seen that implementation Figure 2 The described evaluation method based on engineering vehicle driver status monitoring can determine the NVH subjective evaluation content for engineering vehicles and the driver's driver information, generate at least one driving test task for the driver based on the NVH subjective evaluation content and the driver information, and collect the driver's driving information in the process of the driver driving the engineering vehicle to complete each driving test task, determine the driver's facial information and body movement information based on the driving video information, and determine the driver's state information and line of sight information based on the facial information, determine the driver's operation action information based on the driving operation information and body movement information, improve the accuracy and reliability of determining the driver's state, implementation and operation action information, determine at least one task key point corresponding to each driving test task and the key point instructions corresponding to each task key point, and determine the driver's state information based on the driver's state information. The driver's state information, line of sight information, operation action information and key point instructions corresponding to each key point of the task are used to determine the driver's score information corresponding to each key point of the task, and the driver's corresponding driving test score is determined according to the driver's score information corresponding to each key point of the task, so as to improve the accuracy and efficiency of determining the driver's driving test score, and judge whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle according to the driving test score, so as to improve the real-time monitoring capability of the driver, improve the accuracy and reliability of determining the driver's driving test score, and then improve the accuracy of judging whether the driver meets the subjective evaluation conditions, reduce the occurrence of the situation that the NVH subjective evaluation is affected by the abnormal state of the driver, improve the efficiency and standardization of the NVH subjective evaluation of engineering vehicles, and improve the accuracy and reliability of the NVH subjective evaluation of engineering vehicles.

[0054] In an optional embodiment, according to the driver's state information, sight information, operation action information and key point instructions corresponding to each key point of the task, determining the driver's score information corresponding to each key point of the task may include the following operations:

[0055] For each key task point, the fatigue state score and emotional state score of the driver corresponding to the key task point are determined according to the driver's state information, and the state score of the driver corresponding to the key task point is determined according to the fatigue state score and the emotional state score;

[0056] According to the key point instructions corresponding to each key point of the task, at least one instruction standard action corresponding to each key point instruction and the action standard information corresponding to each instruction standard action are determined, wherein the action standard information includes action standard force information, action standard execution time information and action standard sight line information;

[0057] For each key task point, the driver's sight score at the key task point is determined according to the action standard sight information and the driver's sight information at the key task point;

[0058] For each mission key point, determining the action deviation information between the driver's operation action information at the mission key point and the standard action information corresponding to the key point instruction of the mission key point, the action deviation information including action force deviation information and action execution time deviation information;

[0059] For each mission critical point, the driver's operation action score is determined based on the driver's action deviation information at the mission critical point, and the driver's operation score at the mission critical point is determined based on the driver's line of sight score and operation action score.

[0060] In this optional embodiment, optionally, the driver's status information may include the driver's fatigue status information and emotional status information, and the fatigue status score and emotional status score of the driver corresponding to the key point of the task can be determined based on the driver's status information, and then the driver's status score corresponding to the key point of the task can be determined based on the fatigue status score and the emotional state score. Further, the driver's status weight coefficient at the key point of the task can be determined, and the status weight coefficient may include a fatigue status weight coefficient and an emotional state weight coefficient. Then, the driver's status score corresponding to the key point of the task can be determined based on the driver's fatigue status score, emotional state score and status weight coefficient. This embodiment does not make any limitation.

[0061] In this optional embodiment, optionally, at least one instruction standard action corresponding to each key point instruction may include the operating action required to complete the key point instruction, for example, a series of actions required to complete the gear and throttle handle adjustment steps in the idle start project of an engineering vehicle. The action standard information corresponding to each instruction standard action may include action standard force information, action standard execution time information and action standard line of sight information. The action standard force information may include the action standard execution force and the action standard execution amplitude. The action standard execution time information may include the action marking execution time and the action standard execution duration. The action standard line of sight information may include the action standard line of sight stay range and the action standard line of sight stay duration, which is not limited in this embodiment.

[0062] In this optional embodiment, optionally, the action deviation information may include action force deviation information and action execution time deviation information. The action force deviation information may indicate the deviation information between the driver's operation action force information and the action standard force information. The action execution time deviation information may indicate the deviation information between the driver's operation action execution time information and the action standard execution time information. The driver's operation action force score may be determined based on the deviation information between the driver's operation action force information and the action standard force information. The driver's operation action execution time score may be determined based on the deviation information between the driver's operation action execution time information and the action standard execution time information. Furthermore, the driver's operation action score may be determined based on the operation action force score and the operation action execution time score. This embodiment does not make any limitation.

[0063] It can be seen that the implementation of this optional embodiment can determine the fatigue state score and emotional state score of the driver at each key point of the task, and determine the state score of the driver at the key point of the task based on the fatigue state score and the emotional state score, thereby improving the accuracy and reliability of determining the driver's state score, determining at least one instruction standard action corresponding to each key point instruction and the action standard information corresponding to each instruction standard action, determining the driver's line of sight score at the key point of the task based on the action standard line of sight information and the driver's line of sight information at the key point of the task, determining the action deviation information between the driver's operating action information at the key point of the task and the standard action information corresponding to the key point instruction of the key point of the task, determining the driver's operating action score based on the driver's action deviation information at the key point of the task, and determining the driver's operating score at the key point of the task based on the driver's line of sight score and the operating action score, thereby improving the accuracy and reliability of determining the driver's operating score, improving the real-time monitoring capability of the driver, improving the accuracy and reliability of determining the driver's driving test score, and thereby improving the accuracy of judging whether the driver meets the subjective evaluation conditions.

[0064] In another optional embodiment, for each mission critical point, determining the driver's vision score at the mission critical point according to the action standard vision information and the driver's vision information at the mission critical point may include the following operations:

[0065] For each key point of the task, according to the standard sight line information of the action, determine the standard sight line landing point range corresponding to the key point of the task and the standard sight line stay time corresponding to the standard sight line landing point range;

[0066] For each mission critical point, according to the driver's sight information at the mission critical point, determine the driver's sight point information at the mission critical point, the sight point information including multiple sight points and the sight stay time corresponding to each sight point;

[0067] For each mission critical point, according to the driver's sight point information at the mission critical point and the standard sight point range of the action corresponding to the mission critical point, the discrete information of each sight point relative to the standard sight point range of the action and the driver's sight stay time within the standard sight point range of the action are determined;

[0068] For each key task point, the driver's gaze point score at the key task point is determined based on discrete information, the driver's gaze dwell time score at the key task point is determined based on the driver's gaze dwell time and the action standard gaze dwell time, and the driver's gaze score at the key task point is determined based on the gaze point score and the gaze dwell time score.

[0069] In this optional embodiment, optionally, the standard sight point range corresponding to the key point of the task can indicate the range that the driver needs to visually observe when executing the key point of the task, and the standard sight stay time corresponding to the standard sight point range can indicate the time the driver needs to visually observe the range. The driver's sight point information at the key point of the task may include multiple sight points and the sight stay time corresponding to each sight point, which is not limited in this embodiment.

[0070] In this optional embodiment, optionally, the discrete information can represent the degree of concentration of each of the driver's sight points relative to the standard sight point range corresponding to the key task point. The greater the concentration, the higher the driver's concentration during visual observation, and the higher the driver's sight point score at the key task point. The driver's sight point score at the key task point can be determined based on the difference between the driver's sight stay time and the standard sight stay time. The smaller the difference, the higher the score. The driver's sight score at the key task point can be determined based on the sight point score and the sight stay time score. This embodiment does not limit this.

[0071] It can be seen that the implementation of this optional embodiment can determine the driver's line of sight information at each key task point based on the driver's line of sight information at the key task point, determine the discrete information of each line of sight relative to the standard line of sight range and the driver's line of sight stay time within the standard line of sight range based on the driver's line of sight information at the key task point and the action standard line of sight range corresponding to the key task point, determine the driver's line of sight score at the key task point based on the discrete information, determine the driver's line of sight score at the key task point based on the driver's line of sight stay time and the action standard line of sight stay time, and determine the driver's line of sight score at the key task point based on the line of sight score and the line of sight stay time score, which can improve the accuracy and reliability of determining the driver's line of sight score, reflect the driver's driving concentration through the line of sight score, and thus improve the accuracy of judging whether the driver is suitable for NVH subjective evaluation.

[0072] In yet another optional embodiment, determining the state information and sight information of the driver according to the facial information may include the following operations:

[0073] Determine the driver's facial key point information based on the facial information, where the facial key point information includes eye key point information and mouth key point information;

[0074] Extracting the driver's face target area information according to the driver's face key point information, where the face target area information includes eye target area information and mouth target area information;

[0075] Determine the driver's sight line information according to the driver's eye target area information, and perform binary classification judgment on the driver's face target area information to obtain the driver's face target area opening and closing information, where the face target area opening and closing information includes eye opening and closing information and mouth opening and closing information;

[0076] The opening and closing information of the target face area is analyzed to obtain the fatigue representation information and the emotion representation information of the driver, and the state information of the driver is determined according to the fatigue representation information and the emotion representation information.

[0077] In this optional embodiment, optionally, the driver's facial key point information may include eye key point information and mouth key point information, the driver's facial target area information may include eye target area information and mouth target area information, the driver's facial target area opening and closing information may include eye opening and closing information and mouth opening and closing information, wherein the driver's eye opening and closing information may include at least one of the number of eye opening and closing times, eye opening and closing frequency, and duration of a single eye opening and closing, and the driver's mouth opening and closing information may include at least one of the number of mouth opening and closing times, mouth opening and closing frequency, mouth opening and closing size, and duration of a single mouth opening and closing, and this embodiment does not limit this.

[0078] In this optional embodiment, optionally, the driver's line of sight information can be determined based on the driver's eye target area information. Specifically, the driver's line of sight angle information and line of sight retention duration information can be determined based on the driver's eye target area information, and the driver's line of sight landing point information can be determined based on the driver's line of sight angle information and line of sight retention duration information; the driver's facial target area opening and closing information can be analyzed to obtain the driver's fatigue representation information and emotion representation information, and the driver's state information can be determined based on the fatigue representation information and emotion representation information. Specifically, the driver's facial target area opening and closing information can be analyzed to obtain the driver's blinking frequency, eye corner angle changes, mouth opening and closing frequency, mouth opening and closing size, mouth corner angle changes and other information, thereby determining the driver's fatigue representation information and emotion representation information, which is not limited in this embodiment.

[0079] It can be seen that the implementation of this optional embodiment can determine the driver's facial key point information based on facial information, extract the driver's facial target area information based on the driver's facial key point information, determine the driver's line of sight information based on the driver's eye target area information, and perform binary classification judgment on the driver's facial target area information to obtain the driver's facial target area opening and closing information, the facial target area opening and closing information includes eye opening and closing information and mouth opening and closing information, analyze the facial target area opening and closing information to obtain the driver's fatigue representation information and emotion representation information, and determine the driver's state information based on the fatigue representation information and emotion representation information, and can determine the driver's fatigue state and emotional state based on the driver's facial key point information, improve the accuracy and reliability of determining the driver's fatigue state and emotional state, thereby reducing the occurrence of situations where the driver's driving fatigue and / or abnormal emotional state affects the NVH subjective evaluation, thereby improving the accuracy and efficiency of the NVH subjective evaluation.

[0080] In yet another optional embodiment, the driver information includes the driver's physiological health information and the driver's historical driving information for the engineering vehicle;

[0081] Generating at least one driving test task for the driver according to the NVH subjective evaluation content and the driver information may include the following operations:

[0082] Determine the test environment for the driver based on the NVH subjective evaluation content, and determine at least one test condition for the driver based on the test environment and the driver's physiological health information;

[0083] Determine the driver's driving proficiency of the engineering vehicle based on the driver's historical driving information of the engineering vehicle;

[0084] For each test condition, determining at least one test task for the driver under the test condition according to the driver's driving proficiency of the engineering vehicle;

[0085] At least one driving test task for the driver is screened in each test task according to preset driving test conditions, where the driving test conditions include a driving test quantity condition and a driving test classification condition.

[0086] In this optional embodiment, optionally, the driver information may include the driver's physiological health information and the driver's historical driving information for engineering vehicles, wherein the driver's physiological health information may include one or more combinations of visual ability information, auditory ability information, reaction speed information, coordination information, age information, physical disease information, etc., and the driver's historical driving information for engineering vehicles may include one or more combinations of historical driving time, historical driving mileage, historical driving project execution status, historical accident information, etc., which is not limited to this embodiment.

[0087] In this optional embodiment, optionally, the driver's test environment may include one or more of an indoor working environment, an urban working environment, a town working environment, a mountain working environment, etc. Taking an excavator as an engineering vehicle as an example, at least one test condition for the driver may include one or more combinations of walking conditions, digging conditions, grasping conditions, translation conditions, etc., which are not limited in this embodiment.

[0088] In this optional embodiment, optionally, the driver's driving proficiency for the engineering vehicle can be determined based on the driver's historical driving information for the engineering vehicle, and at least one test task for the driver under the test condition can be determined based on the driver's driving proficiency for the engineering vehicle. At least one driving test task for the driver in each test task can be screened according to preset driving test conditions. The driving test conditions include driving test quantity conditions and driving test classification conditions. The driving test quantity conditions may include a minimum number of driving tests for the driver. The driving test classification conditions give priority to the principle of uniform distribution of test types. For example, at least one test task is screened for each test condition of the excavator. This is not limited to this embodiment.

[0089] It can be seen that the implementation of this optional embodiment can determine the test environment for the driver according to the NVH subjective evaluation content, and determine the driver's driving proficiency for the engineering vehicle according to the test environment and the driver's physiological health information and the driver's historical driving information for the engineering vehicle. For each test condition, at least one test task for the driver under the test condition is determined according to the driver's driving proficiency for the engineering vehicle, and at least one driving test task for the driver is screened in each test task according to preset driving test conditions. The driving test conditions include driving test quantity conditions and driving test classification conditions. Based on the driver's physiological health information, driving proficiency and NVH subjective evaluation content, an exclusive driving test task can be formulated for the driver, thereby improving the accuracy and reliability of determining the driver's driving test score, improving the real-time monitoring capability of the driver, and thereby improving the accuracy of judging whether the driver meets the subjective evaluation conditions.

[0090] In yet another optional embodiment, determining the driving test score corresponding to the driver according to the score information corresponding to each key point of the task may include the following operations:

[0091] Determining a first weight coefficient corresponding to the driver's state score and a second weight coefficient corresponding to the operation score according to the driver's physiological health information and the driver's driving proficiency of the engineering vehicle;

[0092] Calculate the driving test score corresponding to the driver based on the state score, the first weight coefficient, the operation score, the second weight coefficient and the preset calculation rules;

[0093] Furthermore, judging whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle according to the driving test score may include the following operations:

[0094] Determining a driving test score threshold for the driver based on at least one driving test task for the driver, the driver's physiological health information, and the driver's driving proficiency of the engineering vehicle;

[0095] Determine whether the driving test score corresponding to the driver is greater than the driving test score threshold. When the driving test score is greater than the driving test score threshold, determine that the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle. When the driving test score is less than or equal to the driving test score threshold, determine that the driver does not meet the NVH subjective evaluation conditions corresponding to the engineering vehicle.

[0096] In this optional embodiment, optionally, a first weight coefficient corresponding to the driver's status score and a second weight coefficient corresponding to the operation score can be determined based on the driver's physiological health information and the driver's driving proficiency in engineering vehicles. For example, when the driver's driving proficiency in engineering vehicles is high, the first weight coefficient corresponding to the driver's status score can be set greater than the second weight coefficient corresponding to the operation score. The preset calculation rules may include weighted calculation rules or root mean square calculation rules, which are not limited in this embodiment.

[0097] In this optional embodiment, optionally, a driving test score threshold for the driver is determined based on at least one driving test task for the driver, the driver's physiological health information, and the driver's driving proficiency in engineering vehicles, and it is determined whether the driving test score corresponding to the driver is greater than the driving test score threshold. When the driving test score is greater than the driving test score threshold, it is determined that the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle; when the driving test score is less than or equal to the driving test score threshold, it is determined that the driver does not meet the NVH subjective evaluation conditions corresponding to the engineering vehicle. Further optionally, the driving test scores of multiple drivers can be obtained, and then the average driving test scores of the multiple drivers are calculated, and the driving test average score is multiplied by a preset coefficient to determine the driver's driving test score threshold. The preset coefficient may include 0.6 or 0.7, which is not limited in this embodiment.

[0098] It can be seen that the implementation of this optional embodiment can determine the first weight coefficient corresponding to the driver's state score and the second weight coefficient corresponding to the operation score according to the driver's physiological health information and the driver's driving proficiency in the engineering vehicle, calculate the driver's corresponding driving test score based on the state score, the first weight coefficient, the operation score, the second weight coefficient and the preset calculation rule, improve the accuracy and efficiency of determining the driving test score, determine the driving test score threshold for the driver according to at least one driving test task for the driver, the driver's physiological health information and the driver's driving proficiency in the engineering vehicle, and judge whether the driving test score corresponding to the driver is greater than the driving test score threshold. When the driving test score is greater than the driving test score threshold, it is determined that the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle. When the driving test score is less than or equal to the driving test score threshold, it is determined that the driver does not meet the NVH subjective evaluation conditions corresponding to the engineering vehicle. This can improve the accuracy of judging whether the driver meets the subjective evaluation conditions, reduce the occurrence of the situation where the NVH subjective evaluation is affected by the abnormal state of the driver, and improve the efficiency and standardization of the NVH subjective evaluation of engineering vehicles.

[0099] Embodiment 3

[0100] See also Figure 3 , Figure 3: is a schematic diagram of a structural evaluation device based on engineering vehicle driver status monitoring disclosed in an embodiment of the present invention. Figure 3 The evaluation device based on the state monitoring of the engineering vehicle driver described may include an intelligent device for scoring the engineering vehicle driver, and the intelligent device may include any one of a data acquisition device, an intelligent server or an intelligent platform. The data acquisition device may include at least one of a camera, a microphone and a sensor, etc. The intelligent server includes a local server or a cloud server, which is not limited in the embodiment of the present invention. Figure 3 As shown, the evaluation device based on engineering vehicle driver status monitoring may include:

[0101] A determination module 301 is used to determine NVH subjective evaluation content for the engineering vehicle and driver information of the driver, wherein the NVH subjective evaluation content includes at least one of idle evaluation content, driving evaluation content and operation evaluation content;

[0102] A generating module 302 is used to generate at least one driving test task for the driver according to the NVH subjective evaluation content and the driver information, and collect the driver's driving information when the driver drives the engineering vehicle to complete each driving test task, wherein the driving information includes driving video information and driving operation information;

[0103] The determination module 301 is further used to determine the driving test score corresponding to the driver according to the driving information;

[0104] The judgment module 303 is used to judge whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle according to the driving test score.

[0105] It can be seen that the implementation Figure 3 The described evaluation device based on engineering vehicle driver status monitoring can determine the NVH subjective evaluation content for the engineering vehicle and the driver information of the driver, generate at least one driving test task for the driver based on the NVH subjective evaluation content and the driver information, and collect the driver's driving information while the driver is driving the engineering vehicle to complete each driving test task, determine the driver's corresponding driving test score based on the driving information, and judge whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle based on the driving test score. This can improve the real-time monitoring capability of the driver, improve the accuracy and reliability of determining the driver's driving test score, and further improve the accuracy of judging whether the driver meets the subjective evaluation conditions, reduce the occurrence of situations where the NVH subjective evaluation is affected by the abnormal state of the driver, improve the efficiency and standardization of the NVH subjective evaluation of engineering vehicles, and improve the accuracy and reliability of the NVH subjective evaluation of engineering vehicles.

[0106] In an optional embodiment, if Figure 3 As shown, the specific method in which the determination module 301 determines the driving test score corresponding to the driver according to the driving information includes:

[0107] Determine the driver's facial information and body movement information based on the driving video information, and determine the driver's state information and sight information based on the facial information, the state information including fatigue state information and emotional state information;

[0108] Determine the driver's operation action information according to the driving operation information and the body movement information, where the operation action information includes operation action force information and operation action execution time information;

[0109] Determine at least one task key point corresponding to each driving test task and a key point instruction corresponding to each task key point;

[0110] Based on the driver's status information, line of sight information, operation action information and key point instructions corresponding to each key point of the task, the scoring information corresponding to the driver at each key point of the task is determined, and based on the driver's scoring information corresponding to each key point of the task, the driver's corresponding driving test score is determined, and the scoring information includes a status score and an operation score.

[0111] It can be seen that the implementation Figure 3The evaluation device based on engineering vehicle driver status monitoring described herein can determine the NVH subjective evaluation content for the engineering vehicle and the driver's driver information, generate at least one driving test task for the driver based on the NVH subjective evaluation content and the driver information, and collect the driver's driving information while the driver is driving the engineering vehicle to complete each driving test task, determine the driver's facial information and body movement information based on the driving video information, determine the driver's state information and line of sight information based on the facial information, determine the driver's operation action information based on the driving operation information and body movement information, improve the accuracy and reliability of determining the driver's state, implementation and operation action information, determine at least one task key point corresponding to each driving test task and the key point instructions corresponding to each task key point, and determine the driver's state information and line of sight information based on the driving operation information and body movement information. The driver's state information, line of sight information, operation action information and key point instructions corresponding to each key point of the task are used to determine the driver's score information corresponding to each key point of the task, and the driver's corresponding driving test score is determined according to the driver's score information corresponding to each key point of the task, so as to improve the accuracy and efficiency of determining the driver's driving test score, and judge whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle according to the driving test score, so as to improve the real-time monitoring capability of the driver, improve the accuracy and reliability of determining the driver's driving test score, and then improve the accuracy of judging whether the driver meets the subjective evaluation conditions, reduce the occurrence of the situation that the NVH subjective evaluation is affected by the abnormal state of the driver, improve the efficiency and standardization of the NVH subjective evaluation of engineering vehicles, and improve the accuracy and reliability of the NVH subjective evaluation of engineering vehicles.

[0112] In another optional embodiment, Figure 3 As shown, the specific manner in which the determination module 301 determines the scoring information corresponding to each key point of the task by the driver according to the driver's state information, sight information, operation action information and the key point instructions corresponding to each key point of the task includes:

[0113] For each key task point, the fatigue state score and emotional state score of the driver corresponding to the key task point are determined according to the driver's state information, and the state score of the driver corresponding to the key task point is determined according to the fatigue state score and the emotional state score;

[0114] According to the key point instructions corresponding to each key point of the task, at least one instruction standard action corresponding to each key point instruction and the action standard information corresponding to each instruction standard action are determined, wherein the action standard information includes action standard force information, action standard execution time information and action standard sight line information;

[0115] For each key task point, the driver's sight score at the key task point is determined according to the action standard sight information and the driver's sight information at the key task point;

[0116] For each mission key point, determining the action deviation information between the driver's operation action information at the mission key point and the standard action information corresponding to the key point instruction of the mission key point, the action deviation information including action force deviation information and action execution time deviation information;

[0117] For each mission critical point, the driver's operation action score is determined based on the driver's action deviation information at the mission critical point, and the driver's operation score at the mission critical point is determined based on the driver's line of sight score and operation action score.

[0118] It can be seen that implementation Figure 3 The described evaluation device based on engineering vehicle driver status monitoring can determine the driver's fatigue status score and emotional status score corresponding to each key point of the task, and determine the driver's status score corresponding to the key point of the task based on the fatigue status score and the emotional status score, thereby improving the accuracy and reliability of determining the driver's status score, determining at least one instruction standard action corresponding to each key point instruction and the action standard information corresponding to each instruction standard action, determining the driver's line of sight score at the key point of the task based on the action standard line of sight information and the driver's line of sight information at the key point of the task, determining the action deviation information between the driver's operating action information at the key point of the task and the standard action information corresponding to the key point instruction of the key point of the task, determining the driver's operating action score based on the driver's action deviation information at the key point of the task, and determining the driver's operating score at the key point of the task based on the driver's line of sight score and the operating action score, thereby improving the accuracy and reliability of determining the driver's operating score, improving the real-time monitoring capability of the driver, improving the accuracy and reliability of determining the driver's driving test score, and thereby improving the accuracy of judging whether the driver meets the subjective evaluation conditions.

[0119] In yet another optional embodiment, Figure 3 As shown, for each key task point, the determination module 301 determines the driver's sight score at the key task point according to the action standard sight information and the driver's sight information at the key task point. The specific method includes:

[0120] For each key point of the task, according to the standard sight line information of the action, determine the standard sight line landing point range corresponding to the key point of the task and the standard sight line stay time corresponding to the standard sight line landing point range;

[0121] For each mission critical point, according to the driver's sight information at the mission critical point, determine the driver's sight point information at the mission critical point, the sight point information including multiple sight points and the sight stay time corresponding to each sight point;

[0122] For each mission critical point, according to the driver's sight point information at the mission critical point and the standard sight point range of the action corresponding to the mission critical point, the discrete information of each sight point relative to the standard sight point range of the action and the driver's sight stay time within the standard sight point range of the action are determined;

[0123] For each key task point, the driver's gaze point score at the key task point is determined based on discrete information, the driver's gaze dwell time score at the key task point is determined based on the driver's gaze dwell time and the action standard gaze dwell time, and the driver's gaze score at the key task point is determined based on the gaze point score and the gaze dwell time score.

[0124] It can be seen that the implementation Figure 3 The described evaluation device based on engineering vehicle driver status monitoring can determine the driver's line of sight information at each key task point based on the driver's line of sight information at the key task point, determine the discrete information of each line of sight point relative to the standard line of sight range and the driver's line of sight stay duration within the standard line of sight range based on the driver's line of sight information at the key task point and the action standard line of sight range corresponding to the key task point, determine the driver's line of sight score at the key task point based on the discrete information, determine the driver's line of sight score at the key task point based on the driver's line of sight stay duration and the action standard line of sight stay duration, and determine the driver's line of sight score at the key task point based on the line of sight score and the line of sight stay duration score, which can improve the accuracy and reliability of determining the driver's line of sight score, reflect the driver's driving concentration through the line of sight score, and thus improve the accuracy of judging whether the driver is suitable for NVH subjective evaluation.

[0125] In yet another optional embodiment, Figure 3 As shown, the specific manner in which the determination module 301 determines the state information and sight line information of the driver according to the facial information includes:

[0126] Determine the driver's facial key point information based on the facial information, where the facial key point information includes eye key point information and mouth key point information;

[0127] Extracting the driver's face target area information according to the driver's face key point information, where the face target area information includes eye target area information and mouth target area information;

[0128] Determine the driver's sight line information according to the driver's eye target area information, and perform binary classification judgment on the driver's face target area information to obtain the driver's face target area opening and closing information, where the face target area opening and closing information includes eye opening and closing information and mouth opening and closing information;

[0129] The opening and closing information of the target face area is analyzed to obtain the fatigue representation information and the emotion representation information of the driver, and the state information of the driver is determined according to the fatigue representation information and the emotion representation information.

[0130] It can be seen that the implementation Figure 3 The described evaluation device based on engineering vehicle driver status monitoring can determine the driver's facial key point information based on facial information, extract the driver's facial target area information based on the driver's facial key point information, determine the driver's line of sight information based on the driver's eye target area information, and perform binary classification judgment on the driver's facial target area information to obtain the driver's facial target area opening and closing information, the facial target area opening and closing information includes eye opening and closing information and mouth opening and closing information, analyze the facial target area opening and closing information to obtain the driver's fatigue representation information and emotion representation information, and determine the driver's status information based on the fatigue representation information and emotion representation information, and can determine the driver's fatigue state and emotional state based on the driver's facial key point information, improve the accuracy and reliability of determining the driver's fatigue state and emotional state, thereby reducing the occurrence of situations where the driver's driving fatigue and / or abnormal emotional state affects NVH subjective evaluation, thereby improving the accuracy and efficiency of NVH subjective evaluation.

[0131] In yet another optional embodiment, Figure 3 As shown, the driver information includes the driver's physiological health information and the driver's historical driving information for the engineering vehicle;

[0132] The specific manner in which the generating module 302 generates at least one driving test task for the driver according to the NVH subjective evaluation content and the driver information includes:

[0133] Determine the test environment for the driver based on the NVH subjective evaluation content, and determine at least one test condition for the driver based on the test environment and the driver's physiological health information;

[0134] Determine the driver's driving proficiency of the engineering vehicle based on the driver's historical driving information of the engineering vehicle;

[0135] For each test condition, determining at least one test task for the driver under the test condition according to the driver's driving proficiency of the engineering vehicle;

[0136] At least one driving test task for the driver is screened in each test task according to preset driving test conditions, where the driving test conditions include a driving test quantity condition and a driving test classification condition.

[0137] It can be seen that the implementation Figure 3 The evaluation device based on engineering vehicle driver status monitoring described above can determine the test environment for the driver according to the NVH subjective evaluation content, and determine the driver's driving proficiency for the engineering vehicle according to the test environment and the driver's physiological health information and the driver's historical driving information for the engineering vehicle. For each test condition, at least one test task for the driver under the test condition is determined according to the driver's driving proficiency for the engineering vehicle, and at least one driving test task for the driver is screened in each test task according to preset driving test conditions. The driving test conditions include driving test quantity conditions and driving test classification conditions. Based on the driver's physiological health information, driving proficiency and NVH subjective evaluation content, an exclusive driving test task can be formulated for the driver, thereby improving the accuracy and reliability of determining the driver's driving test score, improving the real-time monitoring capability of the driver, and thereby improving the accuracy of judging whether the driver meets the subjective evaluation conditions.

[0138] In yet another optional embodiment, Figure 3 As shown, the specific method of determining the driving test score corresponding to the driver according to the scoring information corresponding to each key point of the task by the determination module 301 includes:

[0139] Determining a first weight coefficient corresponding to the driver's state score and a second weight coefficient corresponding to the operation score according to the driver's physiological health information and the driver's driving proficiency of the engineering vehicle;

[0140] Calculate the driving test score corresponding to the driver based on the state score, the first weight coefficient, the operation score, the second weight coefficient and the preset calculation rules;

[0141] And, the specific manner in which the judgment module 303 judges whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle according to the driving test score includes:

[0142] Determining a driving test score threshold for the driver based on at least one driving test task for the driver, the driver's physiological health information, and the driver's driving proficiency of the engineering vehicle;

[0143] Determine whether the driving test score corresponding to the driver is greater than the driving test score threshold. When the driving test score is greater than the driving test score threshold, determine that the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle. When the driving test score is less than or equal to the driving test score threshold, determine that the driver does not meet the NVH subjective evaluation conditions corresponding to the engineering vehicle.

[0144] It can be seen that the implementation Figure 3 The evaluation device based on engineering vehicle driver status monitoring described herein can determine a first weight coefficient corresponding to the driver's status score and a second weight coefficient corresponding to the operation score according to the driver's physiological health information and the driver's driving proficiency in engineering vehicles, and calculate the driver's corresponding driving test score based on the status score, the first weight coefficient, the operation score, the second weight coefficient and the preset calculation rule, so as to improve the accuracy and efficiency of determining the driving test score, and determine a driving test score threshold for the driver according to at least one driving test task for the driver, the driver's physiological health information and the driver's driving proficiency in engineering vehicles, and judge whether the driving test score corresponding to the driver is greater than the driving test score threshold. When the driving test score is greater than the driving test score threshold, it is determined that the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle, and when the driving test score is less than or equal to the driving test score threshold, it is determined that the driver does not meet the NVH subjective evaluation conditions corresponding to the engineering vehicle, which can improve the accuracy of judging whether the driver meets the subjective evaluation conditions, reduce the occurrence of the situation where the NVH subjective evaluation is affected by the abnormal state of the driver, and improve the efficiency and standardization of the NVH subjective evaluation of engineering vehicles.

[0145] Embodiment 4

[0146] See also Figure 4 , Figure 4 FIG. 1 is a schematic diagram of another structural example of an evaluation device based on monitoring the state of an engineering vehicle driver disclosed in an embodiment of the present invention. Figure 4 As shown, the evaluation device based on engineering vehicle driver status monitoring may include:

[0147] A memory 401 storing executable program codes;

[0148] a processor 402 coupled to the memory 401;

[0149] The processor 402 calls the executable program code stored in the memory 401 to execute the steps of the evaluation method based on the state monitoring of the engineering vehicle driver described in the first embodiment of the present invention or the second embodiment of the present invention.

[0150] Embodiment 5

[0151] An embodiment of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute the steps in the evaluation method based on engineering vehicle driver status monitoring described in Embodiment 1 or Embodiment 2 of the present invention.

[0152] Embodiment 6

[0153] An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute the steps in the evaluation method based on engineering vehicle driver status monitoring described in Example 1 or Example 2.

[0154] The device embodiments described above are only illustrative, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, i.e., they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative work.

[0155] Through the specific description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the above technical solution can be essentially or partly contributed to the prior art in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, a magnetic disk storage, a magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0156] Finally, it should be noted that the evaluation method and device based on engineering vehicle driver status monitoring disclosed in the embodiment of the present invention only discloses a preferred embodiment of the present invention, which is only used to illustrate the technical solution of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, a person of ordinary skill in the art should understand that the technical solutions recorded in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. An evaluation method based on engineering vehicle driver status monitoring, characterized in that: The method comprises: Determining NVH subjective evaluation content for the engineering vehicle and driver information of the driver, wherein the NVH subjective evaluation content includes at least one of idle evaluation content, driving evaluation content, and operation evaluation content; Generate at least one driving test task for the driver according to the NVH subjective evaluation content and the driver information, and collect the driver's driving information when the driver drives the engineering vehicle to complete each driving test task, wherein the driving information includes driving video information and driving operation information; A driving test score corresponding to the driver is determined according to the driving information, and whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle is judged according to the driving test score.

2. The evaluation method based on engineering vehicle driver status monitoring according to claim 1 is characterized in that: Determining the driving test score corresponding to the driver according to the driving information includes: Determine the driver's facial information and body movement information based on the driving video information, and determine the driver's state information and sight line information based on the facial information, wherein the state information includes fatigue state information and emotional state information; Determining the driver's operation action information according to the driving operation information and the body action information, wherein the operation action information includes operation action force information and operation action execution time information; Determine at least one task key point corresponding to each of the driving test tasks and a key point instruction corresponding to each of the task key points; Based on the driver's status information, the line of sight information, the operation action information and the key point instructions corresponding to each key point of the task, the scoring information corresponding to the driver at each key point of the task is determined, and based on the scoring information corresponding to each key point of the task, the driving test score corresponding to the driver is determined, and the scoring information includes a status score and an operation score.

3. The evaluation method based on engineering vehicle driver status monitoring according to claim 2 is characterized in that: Determining the scoring information of the driver corresponding to each of the key points of the task according to the state information, the sight information, the operation action information of the driver, and the key point instructions corresponding to each of the key points of the task, includes: For each of the key task points, determining a fatigue state score and an emotional state score corresponding to the driver at the key task point according to the state information of the driver, and determining a state score corresponding to the driver at the key task point according to the fatigue state score and the emotional state score; According to the key point instructions corresponding to each of the key points of the task, at least one instruction standard action corresponding to each of the key point instructions and action standard information corresponding to each of the instruction standard actions are determined, wherein the action standard information includes action standard force information, action standard execution time information and action standard sight line information; For each of the mission key points, determining a sight score of the driver at the mission key point according to the action standard sight information and the sight information of the driver at the mission key point; For each of the mission key points, determining action deviation information between the driver's operation action information at the mission key point and the standard action information corresponding to the key point instruction of the mission key point, wherein the action deviation information includes action force deviation information and action execution time deviation information; For each of the mission critical points, the driver's operating action score is determined based on the driver's action deviation information at the mission critical point, and the driver's operating score at the mission critical point is determined based on the driver's line of sight score and the operating action score.

4. The evaluation method based on engineering vehicle driver status monitoring according to claim 3 is characterized in that: For each of the mission key points, determining the driver's sight score at the mission key point according to the action standard sight information and the sight information of the driver at the mission key point includes: For each of the task key points, according to the action standard sight line information, determine the action standard sight line landing point range corresponding to the task key point and the action standard sight line stay time corresponding to the action standard sight line landing point range; For each of the mission key points, determining the sight point information of the driver at the mission key point according to the sight line information of the driver at the mission key point, wherein the sight line information includes a plurality of sight line points and a sight stay time corresponding to each sight line point; For each of the mission key points, according to the driver's sight point information at the mission key point and the standard sight point range of the action corresponding to the mission key point, determine the discrete information of each sight point relative to the standard sight point range of the action and the length of time the driver's sight stays within the standard sight point range of the action; For each of the key task points, the driver's sight point score at the key task point is determined based on the discrete information, the driver's sight duration score at the key task point is determined based on the driver's sight duration and the standard sight duration score, and the driver's sight score at the key task point is determined based on the sight point score and the sight duration score.

5. The evaluation method based on engineering vehicle driver status monitoring according to any one of claims 2 to 4, characterized in that: The determining, based on the facial information, the state information and the sight line information of the driver includes: Determine the facial key point information of the driver according to the facial information, wherein the facial key point information includes eye key point information and mouth key point information; Extracting target facial region information of the driver according to key facial point information of the driver, wherein the target facial region information includes eye target region information and mouth target region information; Determine the sight line information of the driver according to the eye target area information of the driver, and perform binary classification judgment on the face target area information of the driver to obtain the face target area opening and closing information of the driver, wherein the face target area opening and closing information includes the eye opening and closing information and the mouth opening and closing information; The opening and closing information of the target facial area is analyzed to obtain fatigue representation information and emotion representation information of the driver, and the state information of the driver is determined according to the fatigue representation information and the emotion representation information.

6. The evaluation method based on engineering vehicle driver status monitoring according to any one of claims 2 to 4, characterized in that: The driver information includes the driver's physiological health information and the driver's historical driving information for the engineering vehicle; The step of generating at least one driving test task for the driver according to the NVH subjective evaluation content and the driver information comprises: Determining a test environment for the driver according to the NVH subjective evaluation content, and determining at least one test condition for the driver according to the test environment and the physiological health information of the driver; Determining the driver's driving proficiency for the engineering vehicle based on the driver's historical driving information for the engineering vehicle; For each of the test conditions, determining at least one test task for the driver under the test condition according to the driver's driving proficiency of the engineering vehicle; At least one driving test task for the driver is screened in each of the test tasks according to preset driving test conditions, wherein the driving test conditions include a driving test quantity condition and a driving test classification condition.

7. The evaluation method based on engineering vehicle driver status monitoring according to claim 6 is characterized in that: Determining the driving test score corresponding to the driver according to the score information corresponding to each of the key points of the task includes: Determining a first weight coefficient corresponding to the driver's state score and a second weight coefficient corresponding to the operation score according to the driver's physiological health information and the driver's driving proficiency of the engineering vehicle; Calculate the driving test score corresponding to the driver based on the state score, the first weight coefficient, the operation score, the second weight coefficient and a preset calculation rule; And, judging whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle according to the driving test score includes: Determining a driving test score threshold for the driver based on at least one driving test task for the driver, physiological health information of the driver, and the driver's driving proficiency of the engineering vehicle; Determine whether the driving test score corresponding to the driver is greater than the driving test score threshold. When the driving test score is greater than the driving test score threshold, determine that the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle. When the driving test score is less than or equal to the driving test score threshold, determine that the driver does not meet the NVH subjective evaluation conditions corresponding to the engineering vehicle.

8. An evaluation device based on engineering vehicle driver status monitoring, characterized in that: The device comprises: A determination module, used to determine NVH subjective evaluation content for the engineering vehicle and driver information of the driver, wherein the NVH subjective evaluation content includes at least one of idle evaluation content, driving evaluation content and operation evaluation content; A generating module, configured to generate at least one driving test task for the driver according to the NVH subjective evaluation content and the driver information, and to collect the driver's driving information while the driver drives the engineering vehicle to complete each driving test task, wherein the driving information includes driving video information and driving operation information; The determination module is further used to determine a driving test score corresponding to the driver according to the driving information; A judgment module is used to judge whether the driver meets the NVH subjective evaluation conditions corresponding to the engineering vehicle according to the driving test score.

9. An evaluation device based on engineering vehicle driver status monitoring, characterized in that: The device comprises: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the evaluation method based on engineering vehicle driver status monitoring as described in any one of claims 1-7.

10. A computer storage medium, characterized in that: The computer storage medium stores computer instructions, and when the computer instructions are called, they are used to execute the evaluation method based on engineering vehicle driver status monitoring as described in any one of claims 1-7.

Images