Driver ability assessment method and system

Abstract

A driver ability evaluation method includes: collecting physiological information of a driver detected by an electronic device worn on the driver during driving, and driving condition information from a vehicle-mounted system, external environment image information, and facial image information of the driver; analyzing the environment image information and the driving condition information to obtain vehicle speed control reaction data related to a specific road condition, and analyzing the environment image information, the physiological information, and the facial image information to obtain mental state data related to the mental state of the driver; and generating an ability evaluation result of the driver according to evaluation results related to vehicle speed control reaction ability and mental state control ability respectively generated based on the vehicle speed control reaction data, the mental state data, and predetermined reference reaction data.

Description

TECHNICAL FIELD

[0001] The present application relates to driver ability assessment, and in particular, to a driver ability assessment method and system. BACKGROUND

[0002] In order to improve driving safety, most vehicles can be equipped with advanced driver assistance systems (ADAS) to reduce the occurrence of situations such as collisions, lane deviations, etc. However, the ADAS currently used has not yet achieved the effectiveness of fully automated driving, so the appropriate driving ability of the driver himself must be combined to minimize the risk. However, the current examination mechanism cannot objectively assess the actual control response ability of the driver while driving, which is one of the issues that needs to be addressed. SUMMARY

[0003] The technical problem to be solved by the present application is to provide a driver ability assessment method and system that can overcome at least one of the shortcomings of the prior art.

[0004] To solve the above technical problems, the driver ability assessment method provided by the present application is used to assess the ability of a driver driving a vehicle and is executed by a computer system. The driver ability assessment method comprises the following steps: (A) collecting physiological information obtained by an electronic device worn by the driver for detecting the physiological condition of the driver during a driving period, and collecting driving condition information about the vehicle, environmental image information about the external environment of the vehicle, and facial image information about the driver obtained by a vehicle-mounted system configured in the vehicle during the driving period; (B) analyzing the environmental image information and the driving condition information to obtain vehicle speed control response data of the driver related to at least one specific road condition, and analyzing the environmental image information, the physiological information, and the facial image information to obtain mental state data related to the mental state of the driver; (C) generating first evaluation results related to vehicle speed control response ability according to the vehicle speed control response data, the mental state data, and predetermined reference response data, and generating second evaluation results related to mental state control ability according to the mental state data; and (D) generating ability evaluation results related to the driver according to at least the first evaluation results and the second evaluation results.

[0005] Preferably, the driver ability assessment method of the present application, the vehicle-mounted system comprises a driving assistance system, and further comprises the following step before step (D): (E) collecting alert records from the vehicle-mounted system provided by the driving assistance system during the driving period in relation to alerts issued when at least one specific dangerous situation is detected. In step (D), the computer system generates the ability assessment result according to the first assessment result, the second assessment result, and the alert records.

[0006] Preferably, the driver ability assessment method of the present application, the driving period is a period during which the vehicle continuously travels for a predetermined period of time, or a period during which the vehicle accumulates a predetermined distance.

[0007] Preferably, the driver ability assessment method of the present application, step (B) includes the following operations: performing image recognition on the environmental image information in relation to the at least one specific road condition to obtain road condition time data corresponding to the at least one specific road condition appearing in the environmental image information, wherein the road condition time data includes a time period corresponding to each occurrence of the at least one specific road condition in the environmental image information; performing facial expression recognition on the facial image information to obtain expression time data corresponding to one or more specific facial expressions associated with one or more specific mental states appearing in the facial image information, wherein the expression time data includes a time period corresponding to each occurrence of one of the specific facial expressions in the facial image information; according to the road condition time data, extracting from the driving condition information a speed control reaction time corresponding to all time periods contained in the road condition time data as the speed control reaction data; according to the road condition time data and the expression time data, extracting from the physiological information a pulse blood pressure data corresponding to all time periods contained in the road condition time data and all time periods contained in the expression time data; and analyzing the compatibility between the road condition time data, the expression time data, and the pulse blood pressure data to determine the mental state data, wherein the mental state data includes the duration of each of the specific mental states and the cumulative number of times the driver is in each specific mental state during the driving period.

[0008] Preferably, the driver ability assessment method of the present application, further comprises the following step after step (D): (F) outputting or transmitting the ability assessment result to at least one user terminal.

[0009] To solve the above technical problems, the driver ability assessment system provided by the present application is used to assess the ability of a driver driving a vehicle, and comprises a receiving module, an analysis module, and an assessment module.

[0010] The receiving module is configured to collect physiological information obtained from an electronic device worn by the driver during a driving period for detecting the physiological condition of the driver, and driving condition information, environmental image information and facial image information obtained from vehicle-mounted systems of the vehicle during the driving period.

[0011] The analyzing module is connected to the receiving module to receive the physiological information, the driving condition information, the environmental image information and the facial image information, and is operated to analyze the environmental image information and the driving condition information to obtain vehicle speed control reaction data of the driver with respect to at least one specific road condition, and analyze the environmental image information, the physiological information and the facial image information to obtain mental state data related to the mental state of the driver.

[0012] The evaluating module is connected to the analyzing module to receive the vehicle speed control reaction data and the mental state data, and is operated to generate a first evaluation result related to the vehicle speed control reaction ability according to the vehicle speed control reaction data, the mental state data and predetermined reference reaction data, and generate a second evaluation result related to the mental state control ability according to the mental state data.

[0013] The evaluating module is further operated to generate an ability evaluation result of the driver according to at least the first evaluation result and the second evaluation result.

[0014] Preferably, in the driver ability evaluation system of the present application, the vehicle-mounted system comprises a driving assistance system, and the receiving module is further configured to collect warning records related to warnings issued by the driving assistance system of the vehicle-mounted system during the driving period when at least one specific dangerous situation is detected. The evaluating module is further connected to the receiving module to receive the warning records, and is operated to generate the ability evaluation result according to not only the first evaluation result and the second evaluation result, but also the warning records.

[0015] Preferably, in the driver ability evaluation system of the present application, the driving period is a period during which the vehicle continuously travels for a predetermined period of time, or a period during which the vehicle accumulates a predetermined mileage.

[0016] Preferably, in the driver ability evaluation system of the present application, the analysis module is configured to: perform image recognition on the environmental image information with respect to the at least one specific road condition to obtain road condition time data corresponding to the at least one specific road condition appearing in the environmental image information, wherein the road condition time data comprises a time period corresponding to each occurrence of the at least one specific road condition in the environmental image information; perform facial expression recognition on the facial image information to obtain expression time data corresponding to one or more specific facial expressions associated with one or more specific mental states appearing in the facial image information, wherein the expression time data comprises a time period corresponding to each occurrence of one of the specific facial expressions in the facial image information; according to the road condition time data, extract speed control reaction time corresponding to all time periods contained in the road condition time data from the driving condition information as the speed control reaction data; according to the road condition time data and the expression time data, extract pulse blood pressure data corresponding to all time periods contained in the road condition time data and all time periods contained in the expression time data from the physiological information; and analyze the compatibility between the road condition time data, the expression time data, and the pulse blood pressure data to determine the mental state data, wherein the mental state data comprises the duration of each occurrence of one of the specific mental states and the cumulative number of occurrences of each specific mental state of the driver during the driving period.

[0017] Preferably, the driver ability evaluation system of the present application further comprises an output module. The output module is connected to the evaluation module and is configured to output or transmit the ability evaluation result from the evaluation module to at least one user terminal.

[0018] Compared with the prior art, the present application obtains the first evaluation result of the driver with respect to the speed control reaction and the second evaluation result of the driver with respect to the mental state control ability through the correlation analysis of the big data in time, such as the physiological information and the facial image information of the driver, the driving condition information of the vehicle, and the environmental image information. Therefore, the ability evaluation result of the driver obtained according to the first evaluation result and the second evaluation result can objectively evaluate the actual control reaction ability and the mental state control ability of the driver, such as the elderly driver. BRIEF DESCRIPTION OF DRAWINGS

[0019] Other features and effects of the present application will be clearly presented in the embodiments with reference to the drawings, wherein:

[0020] Figure 1 is a block diagram illustrating the architecture of the driver ability evaluation system of the embodiment of the present application used in combination with a vehicle-mounted system and a wearable electronic device; and

[0021] Figure 2is a flowchart illustrating an example of how the embodiment can be used to perform a competence assessment procedure for a driver of a vehicle. DETAILED DESCRIPTION

[0022] Before the present application is described in detail, it is to be understood that like components are denoted by like numerals throughout the description.

[0023] Referring to Figure 1 The driver competence assessment system 100 of the embodiment is used to assess the competence of a driver of a vehicle, and can be used in combination with an in-vehicle system 200 configured in the vehicle and an electronic device 300 worn by the driver.

[0024] Preferably, the in-vehicle system 200 can include an electronic control unit (ECU) 21 related to the driving control of the vehicle, a face capturing device 22 for capturing the face of the driver, a dashcam 23 for capturing the external environment of the vehicle, and a driver assistance system (DAS) 24 for providing driving assistance such as lane departure warning, front collision warning, side blind spot warning, etc. It is noted that in the present embodiment, the driver assistance system 24 can also provide warning records related to the warnings issued in response to one or more specific dangerous situations detected (e.g. lane departure, too close to the vehicle in front, etc.).

[0025] The electronic device 300 can be, for example, an electronic bracelet or a smart watch for sensing the physiological condition of the driver such as heart rate / pulse, and can send the obtained physiological information out using wireless communication, but is not limited thereto. It is noted that in other embodiments, the electronic device 300 can also support short-range wireless communication such as, but not limited to, Bluetooth communication, and the in-vehicle system 200 can also be designed to be communicatively connected with the electronic device 300, so that the electronic device 300 can transmit the obtained physiological information to the in-vehicle system 200.

[0026] In the present embodiment, the driver competence assessment system 100 can be implemented as a computer system, and can include, for example, a receiving module 11, an analysis module 12 connected with the receiving module 11, an assessment module 13 connected with the analysis module 12 and the receiving module 11, and an output module 14 connected with the assessment module 13.

[0027] In the present embodiment, the receiving module 11 can comprise an interface unit (not shown) adapted to electrically connect the in-vehicle system 200 and / or a communication unit (not shown) adapted to communicate with the in-vehicle system 200 and the electronic device 300. Thus, when the receiving module 11 is electrically connected or communicatively connected with the in-vehicle system 200, it can receive any data or information from the in-vehicle system 200, and when the receiving module 11 is communicatively connected with the electronic device 300, it can receive physiological information from the electronic device 300. It is noted that, in actual use, if the electronic device 300 is communicatively connected with the in-vehicle system 200, the information received by the receiving module 11 from the in-vehicle system 200 can comprise the physiological information transmitted by the electronic device 300 to the in-vehicle system 200. It is particularly noted that, since the in-vehicle system 200 determines the absolute time axis of the in-vehicle system 200 according to the satellite time contained in the GPS signal received when the event recorder 23 is started and transmits data or information generated or obtained with respect to the absolute time axis to the receiving module 11, the data or information received by the receiving module 11 can effectively avoid the problem of inconsistent time axis (i.e., time axis offset).

[0028] It is noted that the analysis module 12 can support image recognition technology, in particular, image recognition of one or more specific facial expressions (e.g., facial expressions such as tension, anxiety, closing eyes, yawning, and micro-expressions of eye movements (black eyeball movements)) associated with one or more specific mental states (e.g., mental states such as tension, anxiety, fatigue, inattention, etc.) of the driver for one or more specific road conditions (e.g., intersections, fork junctions, multi-junctions, pedestrian crossings, elevated roads, continuous curves, highways, etc.) during the driving of the vehicle. The evaluation module 13 has stored therein predetermined reference reaction data obtained through big data collection and analysis. For example, the predetermined reference reaction data includes, but is not limited to, reference brake / deceleration reaction times of a qualified driver for each specific road condition under various different mental states (e.g., normal, tension, anxiety, fatigue, inattention, calmness, and other mental states). The other operations of the analysis module 12 and the detailed operations of the evaluation module 13 will be described below.

[0029] In the present embodiment, the output module 14 can comprise a display module or a printing module (not shown), or can comprise a communication module (not shown) communicatively connectable with one or more user terminals 400 (only one is shown). The user terminal(s) 400 can include at least one of a terminal device (e.g., a mobile phone, a personal computer, a tablet computer, etc.) held by a user related to the driver, and a server device belonging to a supervisory authority and an insurance agency. Figure 1 ​

[0030] Hereinafter, the driver ability assessment system 100 will be described in detail with reference to the flowchart of Fig. 2, which illustrates how the driver ability assessment system 100 performs an ability assessment procedure for the driver. The ability assessment procedure may, for example, include the following steps S21-S26. Figure 1 Figure 2

[0031] First, in step S21, the receiving module 11 collects, through the electrical connection or communication connection with the in-vehicle system 200, the physiological information obtained by the electronic device 300 for detecting the physiological condition of the driver during a driving period, the driving condition information obtained by the electronic control unit 21 of the in-vehicle system 200 during the driving period (which may, for example, include information such as the accelerator, engine acceleration / deceleration, brake, and steering wheel angular velocity with respect to time), the environmental image information obtained by the event data recorder 23 of the in-vehicle system 200 regarding the external environment in which the vehicle is located, and the facial image information obtained by the face camera 22 of the in-vehicle system 200 regarding the driver, and outputs the collected physiological information, driving condition information, environmental image information, and facial image information to the analysis module 12. It is worth noting that, in the present embodiment, the driving period can be a period in which the vehicle continuously travels for a predetermined period of time, or a period in which the vehicle accumulatively travels for a predetermined distance. In other words, the driving period can be set to a relatively short period or a relatively long period according to actual needs.

[0032] ​​Then, in step S22, the analysis module 12 operates to analyze the environmental image information and the driving condition information to obtain the driver's speed control reaction data with respect to the specific road condition(s), and analyze the environmental image information, the physiological information and the facial image information to obtain the mental state data related to the driver's mental state, and output the speed control reaction data and the mental state data to the evaluation module 13. More specifically, the analysis module 12 performs the following operations in step S22; using image recognition techniques related to road condition recognition, performing image recognition on the environmental image information with respect to the specific road condition(s) to obtain road condition time data corresponding to each of the specific road condition(s) appearing in the environmental image information, wherein the road condition time data can include time periods corresponding to each occurrence of one of the specific road conditions in the environmental image information; using image recognition techniques related to facial expression recognition, performing facial expression recognition on the facial image information to obtain expression time data corresponding to the specific facial expressions associated with the specific mental state(s) appearing in the facial image information, wherein the expression time data includes time periods corresponding to each occurrence of one of the specific facial expressions in the facial image information; according to the road condition time data, extracting speed control reaction time (e.g., brake / deceleration reaction time) corresponding to all time periods contained in the road condition time data from the driving condition information as the speed control reaction data; according to the road condition time data and the expression time data, extracting heart rate data corresponding to all time periods contained in the road condition time data and all time periods contained in the expression time data from the physiological information; and analyzing the compatibility between the road condition time data, the expression time data and the heart rate data to determine the mental state data under the specific road condition, wherein the mental state data includes the duration of each occurrence of one of the specific mental states and the cumulative number of occurrences of each specific mental state during the driving period of the driver.

[0033] For example, for an elderly driver, when the vehicle is approaching a road intersection with a red light, the analysis module 12 can analyze whether the elderly driver has the eye movement of looking at the signal (i.e., the black eyeball moves diagonally) according to the facial image information, can analyze the elderly driver's ability or habit of controlling deceleration / braking according to the speed control reaction data, and can analyze whether the vehicle's stopping position (i.e., the distance between the vehicle and the preceding vehicle or the stop line) is appropriate according to the environmental information; or when the vehicle is turning or changing lanes, the analysis module 12 can analyze whether the elderly driver has the eye movement of looking at the rearview mirror or has the action of turning the head according to the facial image information, and can analyze the angular velocity of the vehicle's steering wheel according to the driving condition information. Thus, if the analysis module 12 analyzes that the elderly driver does not look at the signal when the vehicle approaches the road intersection with a red light or the vehicle's stopping position exceeds the stop line, or analyzes that the elderly driver does not turn the head or look at the rearview mirror and quickly turns the steering wheel when the vehicle is turning or changing lanes, the analysis module 12 can further mark the relevant information, which can be used as a marker of bad driving habits for the evaluation module 13 to refer to in subsequent evaluation.

[0034] Next, in step S23, the evaluation module 13 generates a first evaluation result related to the speed control reaction ability according to the received speed control reaction data, the mental state data, and the predetermined reference reaction data, and generates a second evaluation result related to the mental state control ability according to the received mental state data. More specifically, the evaluation module 13 can first calculate the average reaction time of the driver's speed control (maintaining speed, braking / deceleration) reaction time for each specific road condition and in the same mental state by looking up the speed control reaction data and the mental state data, then compare the calculated average reaction time with the reference braking / deceleration reaction time corresponding to the specific road condition and the mental state contained in the predetermined reference reaction data to obtain a corresponding comparison result, and then take all the comparison results related to all specific road conditions and all mental states as the first evaluation result. For example, the first evaluation result can be related to two indicators, one of which is the braking reaction ability for emergency situations, by which it is evaluated whether the driver will cause a speed surge due to mental tension when driving through a complex intersection, and the other of which is the stability ability for maintaining speed. On the other hand, the evaluation module 13 can calculate the frequency and average duration of the driver's mental state, especially the frequency and average duration of the driver's mental state that is not conducive to driving safety, such as fatigue and inattention, by looking up the mental state data, and take the calculated frequency and average duration as the second evaluation result.

[0035] On the other hand, in step S24, the receiving module 11 also collects, from the in-vehicle system 200, a warning record related to the warning issued by the driver assistance system 24 for detecting the specific dangerous situation(s) during the driving period. However, in other embodiments, step S24 can be omitted if the vehicle is not equipped with any driver assistance system.

[0036] In step S25 following steps S23 and S24, the assessment module 13 generates an ability assessment result about the driver based on the first assessment result, the second assessment result, and the warning record received from the in-vehicle system 200, and transmits the ability assessment result to the output module 14. More specifically, the ability assessment result can include the driver's performance in the vehicle speed control reaction ability (i.e., fast reaction, slow reaction, or general reaction) assessed from the first assessment result, the driver's performance in the mental state control ability (i.e., good control, poor control, or general control) assessed from the second assessment result, and the driver's performance in the driving habit (i.e., safe driving or dangerous driving) assessed from the warning record. Specifically, the driver's performance assessed from the warning record, such as the case where the driver assistance system initiates the relevant assistance driving operation for avoiding the preceding vehicle collision and / or lane deviation too frequently, will cause the ability assessment result to reflect that the driver's driving habit tends to be dangerous driving and is not suitable for driving on the road. It is worth noting that in other embodiments where the vehicle is not equipped with any driver assistance system, the assessment module 13 can also generate the ability assessment result based on only the first assessment result and the second assessment result.

[0037] Finally, in step S26, the output module 14 can output the ability assessment result received from the assessment module 13 in the form of display or printing, or can transmit the ability assessment result to the user terminal(s) 400. More specifically, if the user terminal(s) 400 include the terminal device held by the user (e.g., the company supervisor of the professional driver) related to the driver, the user can decide whether the driver is competent (e.g., for the job of professional driving) based on the ability assessment result; if the user terminal(s) 400 include the server device belonging to the insurance agency, the insurance agency can decide the car insurance premium rate of the driver based on the ability assessment result; if the user terminal(s) 400 include the server device belonging to the supervisory agency, the supervisory agency can use the ability assessment result as an objective basis for whether to give the driver (e.g., the elderly driver) a license renewal.

[0038] In summary, the driver ability evaluation system 100 of the present application can obtain the first evaluation result of the driver regarding the speed control reaction and the second evaluation result regarding the mental state control ability through the correlation analysis of the time of the big data of the physiological information and the facial image information of the driver, the vehicle driving condition information, the environmental image information, etc. obtained through the long-term or short-term monitoring during the driving of the driver and the vehicle, and obtain the warning record of the vehicle, so that the ability evaluation result of the driver obtained according to the first evaluation result, the second evaluation result and the warning record can objectively evaluate the actual control reaction ability, the mental state control ability and the driving habit of the driver such as the elderly driver or the professional driver during the driving. Therefore, the driver ability evaluation system 100 of the present application can achieve the purpose of the present application.

[0039] The above is only a specific embodiment of the present application, but the protection scope of the present application is not limited thereto, any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method of driver ability assessment for assessing the ability of a driver to drive a vehicle and performed using a computer system, the method comprising: The driver ability assessment method comprises the following steps: (A) collecting physiological information obtained from an electronic device worn by the driver during a driving period for detecting the driver's physiological condition, and collecting driving condition information about the vehicle, environmental image information about the external environment in which the vehicle is located, and facial image information about the driver obtained from a vehicle-mounted system configured in the vehicle during the driving period; (B) analyzing the environmental image information and the driving condition information to obtain the driver's speed control reaction data regarding at least one specific road condition, and analyzing the environmental image information, the physiological information, and the facial image information to obtain mental state data related to the mental state of the driver; (C) generating a first assessment result related to the speed control reaction ability according to the speed control reaction data, the mental state data, and predetermined reference reaction data, and generating a second assessment result related to the mental state control ability according to the mental state data; and (D) generating an ability assessment result related to the driver according to at least the first assessment result and the second assessment result; Step (B) of the driver ability assessment method further comprises the following operations: performing image recognition on the environmental image information regarding the at least one specific road condition to obtain road condition time data corresponding to the at least one specific road condition appearing in the environmental image information, wherein the road condition time data includes a time period corresponding to each occurrence of the at least one specific road condition in the environmental image information; performing facial expression recognition on the facial image information to obtain expression time data corresponding to one or more specific facial expressions associated with one or more specific mental states appearing in the facial image information, wherein the expression time data includes a time period corresponding to each occurrence of one of the one or more specific facial expressions in the facial image information; According to the road condition time data, the speed control reaction time corresponding to all time periods contained in the road condition time data is extracted from the driving condition information as the speed control reaction data; According to the road condition time data and the expression time data, the pulse blood pressure data corresponding to all time periods contained in the road condition time data and all time periods contained in the expression time data is extracted from the physiological information; and analyze the compatibility between the road condition time data, the expression time data, and the pulse blood pressure data to determine the mental state data, wherein the mental state data includes the duration of each occurrence of one of the one or more specific mental states and the cumulative number of times of each specific mental state of the driver during the driving period.

2. The driver ability assessment method according to claim 1, wherein the in-vehicle system includes a driving assistance system. Before step (D), the following step is further included: (E) collecting warning records related to warnings provided by the driving assistance system when at least one specific dangerous situation is detected during the driving period from the vehicle-mounted system; In step (D), the computer system generates the ability assessment result according to not only the first assessment result and the second assessment result, but also the warning records.

3. The driver ability assessment method according to claim 1 or 2, characterized by, The driving period is a period in which the vehicle continuously travels for a predetermined period of time, or a period in which the vehicle accumulates a predetermined distance of travel.

4. The driver ability evaluation method according to claim 1 or 2, characterized by, After step (D), the following step is further included: (F) outputting or transmitting the capability evaluation result to at least one user terminal.

5. A driver ability assessment system for assessing the ability of a driver to drive a vehicle, characterised in that, Further included are: a receiving module configured to collect physiological information obtained from an electronic device worn by the driver for detecting the physiological condition of the driver during a driving period, and vehicle condition information, environmental image information about the external environment of the vehicle, and facial image information about the driver obtained from the vehicle-mounted system of the vehicle during the driving period; an analysis module connected to the receiving module to receive the physiological information, the vehicle condition information, the environmental image information, and the facial image information, and configured to analyze the environmental image information and the vehicle condition information to obtain vehicle speed control reaction data of the driver with respect to at least one specific road condition, and analyze the environmental image information, the physiological information, and the facial image information to obtain mental state data related to the mental state of the driver; and an evaluation module connected to the analysis module to receive the vehicle speed control reaction data and the mental state data, and configured to generate first evaluation results related to vehicle speed control reaction capability based on the vehicle speed control reaction data, the mental state data, and predetermined reference reaction data, and generate second evaluation results related to mental state control capability based on the mental state data; the evaluation module is further configured to generate capability evaluation results of the driver based on at least the first evaluation results and the second evaluation results; The analysis module of the driver capability evaluation system further includes the following operations: using image recognition technology, performing image recognition on the environmental image information with respect to the at least one specific road condition to obtain road condition time data corresponding to the at least one specific road condition appearing in the environmental image information, wherein the road condition time data includes a time period corresponding to each occurrence of the at least one specific road condition in the environmental image information; using image recognition technology, performing facial expression recognition on the facial image information to obtain expression time data corresponding to one or more specific facial expressions associated with one or more specific mental states appearing in the facial image information, wherein the expression time data includes a time period corresponding to each occurrence of one of the one or more specific facial expressions in the facial image information; based on the road condition time data, extracting vehicle speed control reaction time corresponding to all time periods contained in the road condition time data from the vehicle condition information as the vehicle speed control reaction data; based on the road condition time data and the expression time data, extracting pulse blood pressure data corresponding to all time periods contained in the road condition time data and all time periods contained in the expression time data from the physiological information; and analyzing the road condition time data, the facial expression time data and the pulse blood pressure data for compatibility with each other to determine the mental state data, wherein the mental state data comprises a duration of each time the driver is in one of the one or more specific mental states and a cumulative number of times the driver is in each specific mental state during the driving period.

6. The driver ability evaluation system according to claim 5, wherein the in-vehicle system comprises a driving assistance system. The receiving module further collects alert records from the in-vehicle system related to alerts provided by the driving assistance system during the driving period when at least one specific dangerous situation is detected; and The evaluation module is further connected to the receiving module to receive the alert records and to generate the ability evaluation result based on not only the first evaluation result and the second evaluation result but also the alert records.

7. The driver ability assessment system according to claim 5 or 6, characterized by The driving period is a period during which the vehicle continuously travels a predetermined period of time or a period during which the vehicle accumulatively travels a predetermined distance.

8. The driver ability assessment system according to claim 5 or 6, characterized by The system further comprises an output module connected to the evaluation module and operative to output or transmit the ability evaluation result from the evaluation module to at least one user terminal. analyzing the road condition time data, the facial expression time data and the pulse blood pressure data for compatibility with each other to determine the mental state data, wherein the mental state data comprises a duration of each time the driver is in one of the one or more specific mental states and a cumulative number of times the driver is in each specific mental state during the driving period.

6. The driver ability evaluation system according to claim 5, wherein the in-vehicle system comprises a driving assistance system. The receiving module further collects alert records from the in-vehicle system related to alerts provided by the driving assistance system during the driving period when at least one specific dangerous situation is detected; and The evaluation module is further connected to the receiving module to receive the alert records and to generate the ability evaluation result based on not only the first evaluation result and the second evaluation result but also the alert records. The driving period is a period during which the vehicle continuously travels a predetermined period of time or a period during which the vehicle accumulatively travels a predetermined distance. The system further comprises an output module connected to the evaluation module and operative to output or transmit the ability evaluation result from the evaluation module to at least one user terminal.

Images