Driving evaluation control device and driving evaluation control method

Abstract

To appropriately evaluate a sign of dangerous driving.SOLUTION: A driving evaluation control device includes: a video data acquisition section for acquiring video data being a video of a driver of a vehicle; an emotion determination section for inferring the emotion level of the driver based on the video data and determining whether or not the inferred emotion level is equal to or more than a threshold level; a vehicle information acquisition section for acquiring vehicle information which indicates the behavior of the vehicle; an abnormal travel determination section for determining whether or not the vehicle is abnormally traveling based on the vehicle information; and a dangerous driving determination section for determining a sign of the dangerous driving by the driver based on timing when it is determined that the emotion level is equal to or more than the threshold level and timing when it is determined that the vehicle is abnormally traveling in a case where it is determined that the emotion level is equal to or more than the threshold level and also it is determined that the vehicle is abnormally traveling.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a driving evaluation control device and a driving evaluation control method. [Background technology]

[0002] A technique has been disclosed for observing the behavior of a vehicle and determining the possibility of dangerous driving (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-102092 Summary of the Invention [Problem to be solved by the invention]

[0004] When a driver's emotions change, such as when they become irritated, they may engage in so-called dangerous driving, such as tailgating or intentionally cutting in. Dangerous driving may lead to accidents involving their own vehicle or other vehicles. Therefore, it is desirable to appropriately evaluate the signs of dangerous driving.

[0005] An object of the present invention is to provide a driving evaluation control device and a driving evaluation control method that can appropriately evaluate signs of dangerous driving. [Means for solving the problem]

[0006] The driving evaluation control device of the present invention comprises a video data acquisition unit that acquires video data that is video of the driver of a vehicle; an emotion judgment unit that infers the emotional level of the driver based on the video data and determines whether the inferred emotional level is above a threshold level; a vehicle information acquisition unit that acquires vehicle information that indicates the behavior of the vehicle; an abnormal driving judgment unit that determines whether the vehicle is driving abnormally based on the vehicle information; and a dangerous driving judgment unit that, when the emotional level is judged to be above the threshold level and the vehicle is judged to be driving abnormally, judges whether the driver is about to engage in dangerous driving based on the timing at which the emotional level is judged to be above the threshold level and the timing at which the vehicle is judged to be driving abnormally.

[0007] The driving evaluation control method according to the present invention includes the steps of acquiring video data that is video of a vehicle driver, estimating the emotional level of the driver based on the video data and determining whether the estimated emotional level is equal to or greater than a threshold level, acquiring vehicle information that indicates the behavior of the vehicle, and determining whether the vehicle is driving abnormally based on the vehicle information, and, when the emotional level is determined to be equal to or greater than the threshold level and it is determined that the vehicle is driving abnormally, determining whether there are signs that the driver will engage in dangerous driving based on the timing at which it was determined that the emotional level was equal to or greater than the threshold level and the timing at which it was determined that the vehicle is driving abnormally. [Effects of the Invention]

[0008] According to the present invention, signs of dangerous driving can be appropriately evaluated. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a driving evaluation device according to the first embodiment. [Figure 2] FIG. 2 is a flowchart showing an example of the flow of processing performed by the driving evaluation device according to the first embodiment. [Figure 3] FIG. 3 is a flowchart showing an example of the flow of processing performed by the driving evaluation device according to the second embodiment. [Figure 4] FIG. 4 is a flowchart showing an example of the flow of processing performed by the driving evaluation device according to the third embodiment. [Figure 5] FIG. 5 is a flowchart showing an example of the flow of processing performed by the driving evaluation device according to the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to this embodiment, and in the following embodiments, the same components are designated by the same reference numerals, and redundant explanations will be omitted.

[0011] [First embodiment] (Driving evaluation device) An example of the configuration of the driving evaluation device according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing an example of the configuration of the driving evaluation device according to the first embodiment.

[0012] As shown in FIG. 1, the driving evaluation device 10 includes an imaging unit 20, a biosensor 22, an input unit 24, a display unit 26, an audio output unit 28, a storage unit 30, a CAN (Controller Area Network) interface unit 32, a communication unit 34, and a control unit (driving evaluation control device) 36. The driving evaluation device 10 is mounted on a vehicle. The driving evaluation device 10 may be a device mounted on the vehicle, or may be a portable device that can be used in the vehicle. The driving evaluation device 10 evaluates signs of dangerous driving by the driver based on the timing of a change in the emotional level of the vehicle driver and the timing of abnormal vehicle driving.

[0013] The imaging unit 20 is a camera that is arranged facing the interior of the vehicle and captures images of the interior of the vehicle. The imaging unit 20, for example, captures at least the facial expression of the vehicle driver. The imaging unit 20 is, for example, configured with a wide-angle camera that can capture an image over a range of approximately 180°. The imaging unit 20 may, for example, be configured with a group of multiple cameras. The imaging unit 20 may, for example, be configured with an infrared camera or a visible light camera. The imaging unit 20 may, for example, have a microphone that captures sound within the vehicle cabin.

[0014] The biosensor 22 is a sensor that detects biometric information of the vehicle driver. The biosensor 22 may be disposed, for example, on the steering wheel or the driver's seat, but is not limited thereto. The biosensor 22 detects the biometric information of the vehicle driver at predetermined intervals, for example, and stores the detection results. The biosensor 22 is composed of, for example, a pulse sensor, a blood pressure sensor, a body temperature sensor, a sweat sensor, an electroencephalogram sensor, a cerebral blood flow sensor, and a respiration sensor, but may also be composed of sensors that detect other biometric information.

[0015] The input unit 24 accepts various operations for the driving evaluation device 10. The input unit 24 is configured with various input devices such as buttons, switches, and touch panels.

[0016] The display unit 26 displays various images. For example, the display unit 26 can function as a notification unit that displays an image to alert the driver when it is determined that the driver is about to engage in dangerous driving. The display unit 26 is, for example, a display including a liquid crystal display (LCD), an organic electroluminescence (EL), or a head-up display.

[0017] The audio output unit 28 outputs various sounds. For example, the audio output unit 28 can function as a notification unit that outputs a sound to alert the driver when it is determined that the driver is about to engage in dangerous driving. The audio output unit 28 is, for example, configured with a speaker mounted on the vehicle.

[0018] The storage unit 30 is a memory that stores various types of information. The storage unit 30 stores, for example, information such as the contents of calculations performed by the control unit 36 ​​and programs. The storage unit 30 includes, for example, at least one of a RAM (Random Access Memory), a main storage device such as a ROM (Read Only Memory), and an external storage device such as an HDD (Hard Disk Drive).

[0019] The CAN interface unit 32 is an interface for acquiring various vehicle information via the CAN. The vehicle information includes, for example, information on the engine operating status, the vehicle running status, and the distance to a preceding vehicle detected by a distance measuring sensor (not shown).

[0020] The communication unit 34 transmits and receives data to and from external devices. For example, the communication unit 34 transmits and receives data to and from terminal devices such as smartphones of people around the vehicle. The communication unit 34 is configured to communicate using methods such as Wi-Fi (registered trademark) and Bluetooth (registered trademark).

[0021] The control unit 36 ​​controls the operation of each unit of the driving evaluation device 10. The control unit 36 ​​is realized, for example, by a central processing unit (CPU) or a micro processing unit (MPU) executing a program stored in the storage unit 30 or the like using a RAM or the like as a work area. The control unit 36 ​​may be realized, for example, by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The control unit 36 ​​may be realized by a combination of hardware and software.

[0022] The control unit 36 ​​includes a video data acquisition unit 40, a biometric information acquisition unit 42, a vehicle information acquisition unit 44, an emotion determination unit 46, an abnormal driving determination unit 48, a dangerous driving determination unit 50, and a notification control unit 52.

[0023] The video data acquisition unit 40 acquires video data from the imaging unit 20. The video data acquisition unit 40 acquires, for example, video data from the imaging unit 20 capturing the driver's facial expression, complexion, facial temperature, and line of sight.

[0024] The biometric information acquiring unit 42 acquires biometric information of the vehicle driver from the biometric sensor 22. The biometric information acquiring unit 42 may acquire biometric information such as the pulse rate, heart rate, blood pressure, body temperature, sweating, brain waves, cerebral blood flow, and respiratory rate of the vehicle driver from, for example, a wearable device (not shown) worn by the vehicle driver.

[0025] The vehicle information acquisition unit 44 acquires vehicle information indicating the behavior of the vehicle, including at least one of status information indicating various vehicle conditions, such as speed, acceleration, steering angle, and accelerator opening, and driving operation information indicating the driver's driving operation, such as the amount of braking and accelerator operation, via the CAN interface unit 32. The vehicle information acquisition unit 44 may acquire vehicle information from various sensors, such as an acceleration sensor (not shown) that senses the vehicle condition and a distance sensor that measures the distance to other vehicles and objects around the vehicle.

[0026] The emotion determination unit 46 determines an emotion level indicating the degree of emotion of the vehicle driver. For example, the emotion determination unit 46 estimates the driver's emotion type and emotion level based on video data acquired by the video data acquisition unit 40 and determines whether the estimated emotion level is equal to or higher than a threshold level. For example, the emotion determination unit 46 recognizes the driver's facial expression using image recognition technology and estimates that the driver is anger. The emotion determination unit 46 may also estimate the emotion level from the facial expression and determine that the emotion level is equal to or higher than a predetermined level. For example, the emotion determination unit 46 may estimate that the driver is excited when it determines that the driver's face is flushed using image processing technology. The emotion determination unit 46 may determine whether the driver's emotion level is equal to or higher than a threshold level based on biometric information acquired by the biometric information acquisition unit 42, such as a sudden increase in pulse rate or a change in brain waves. In this embodiment, the emotion determination unit 46 determines the intensity of emotion when the emotion type mainly indicates anger or excitement.

[0027] The abnormal driving determination unit 48 determines whether the vehicle is driving abnormally based on the vehicle information acquired by the vehicle information acquisition unit 44. The abnormal driving determination unit 48 determines that the vehicle is driving abnormally, such as snaking, sudden acceleration, or tailgating, when, for example, the vehicle information indicates that the vehicle is driving at a speed or acceleration exceeding a predetermined threshold, or that the steering operation amount or accelerator operation amount is equal to or exceeds a predetermined threshold, or that the inter-vehicle distance to other vehicles traveling nearby exceeds a predetermined threshold.

[0028] The dangerous driving determination unit 50 determines whether the driver of the vehicle is about to engage in dangerous driving. The dangerous driving determination unit 50 determines whether the driver of the vehicle is about to engage in dangerous driving, for example, based on the timing when the emotion level of the driver is determined to be equal to or higher than a threshold level and the timing when the vehicle is determined to be driving abnormally.

[0029] The notification control unit 52 executes notification processing. When the reckless driving determination unit 50 determines that there is a sign that the driver of the vehicle is about to engage in reckless driving, the notification control unit 52 executes notification processing to at least one of the driver of the vehicle and people outside the vehicle.

[0030] (Driving evaluation device processing) The processing of the driving evaluation device according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a flowchart showing an example of the processing flow of the driving evaluation device according to the first embodiment.

[0031] The video data acquisition unit 40 acquires video data (step S10). Specifically, the video data acquisition unit 40 acquires, for example, video data capturing an image of the driver's facial expression from the imaging unit 20. Then, the process proceeds to step S12.

[0032] The emotion determination unit 46 determines the emotion of the driver (step S12). Specifically, the emotion determination unit 46 determines the type and intensity of the driver's emotion, such as joy, anger, sadness, fun, or excitement, based on the video data of the driver's facial expression acquired by the video data acquisition unit 40. The emotion determination unit 46 may determine the type and intensity of the driver's emotion, for example, using a well-known method. In this embodiment, the emotion determination unit 46 determines the intensity of the emotion when the emotion type mainly indicates anger or excitement. Then, the process proceeds to step S14.

[0033] The emotion determination unit 46 determines whether the emotion level, which indicates the degree of intensity of the driver's emotion, is equal to or greater than a threshold (step S14). Specifically, the emotion determination unit 46 analyzes the driver's eyes, mouth, or gestures based on video data of the driver's facial expression, for example, and classifies the driver's emotion level into three levels, such as "low," "medium," and "high." The emotion determination unit 46 determines, for example, whether the driver's emotion level is equal to or greater than "medium" among "low," "medium," and "high." The emotion determination unit 46 may, for example, calculate the driver's emotion level as a numerical value and determine whether the calculated numerical value is equal to or greater than a predetermined threshold. If it is determined that the emotion level is equal to or greater than the threshold (step S14; Yes), the process proceeds to step S16. If it is not determined that the emotion level is equal to or greater than the threshold (step S14; No), the process proceeds to step S28.

[0034] If the determination in step S14 is Yes, the vehicle information acquisition unit 44 acquires vehicle information (step S16). Specifically, the vehicle information acquisition unit 44 acquires the vehicle information from, for example, the CAN interface unit 32. Then, the process proceeds to step S18.

[0035] The abnormal driving determination unit 48 determines whether the vehicle is driving abnormally (step S18). Specifically, the abnormal driving determination unit 48 determines that the vehicle is driving abnormally when the vehicle information is equal to or greater than a threshold. More specifically, the abnormal driving determination unit 48 determines that the vehicle is driving abnormally when, for example, the vehicle speed or acceleration increases by a predetermined amount or more, when the steering operation amount or accelerator operation amount is equal to or greater than a predetermined threshold, or when the inter-vehicle distance between the vehicle and other vehicles traveling nearby changes in a direction that makes the inter-vehicle distance shorter than a predetermined distance. If it is determined that the vehicle is driving abnormally (step S18; Yes), the process proceeds to step S20. If it is not determined that the vehicle is driving abnormally (step S18; No), the process proceeds to step S28.

[0036] If the determination in step S18 is Yes, the dangerous driving determination unit 50 determines whether the timing at which the driver's emotional level is determined to be above the threshold and the timing at which the vehicle is determined to be driving abnormally are predetermined timings (step S20). Specifically, the dangerous driving determination unit 50 determines whether the time between the timing at which the driver's emotional level is determined to be above the threshold and the timing at which the vehicle is determined to be driving abnormally is equal to or less than a predetermined time. The predetermined time is, for example, about 1 to 10 seconds, but is not limited thereto. If it is determined that the timing at which the driver's emotional level is determined to be above the threshold and the timing at which the vehicle is determined to be driving abnormally are predetermined timings (step S20; Yes), the process proceeds to step S22. If it is not determined that the timing at which the driver's emotional level is determined to be above the threshold and the timing at which the vehicle is determined to be driving abnormally are predetermined timings (step S20; No), the process proceeds to step S26.

[0037] If the determination in step S20 is Yes, the dangerous driving determination unit 50 determines that there is a sign that the driver will engage in dangerous driving (step S22). That is, if the time between the time when the driver's emotional level is determined to be equal to or higher than the threshold and the time when the vehicle is determined to be driving abnormally is equal to or shorter than a predetermined time, the dangerous driving determination unit 50 determines that the driver may engage in dangerous driving. Then, the process proceeds to step S24.

[0038] The notification control unit 52 executes a notification process (step S24). Specifically, the notification control unit 52 executes the notification process, for example, to at least one of the vehicle interior and the surrounding area of ​​the vehicle. Specifically, the notification control unit 52 controls the audio output unit 28 to output a voice message encouraging the driver to drive safely, such as, "Please drive safely." The notification control unit 52 may also control the audio output unit 28 to output a voice message to calm the driver, such as, "Please calm down and relax" or "Please take a deep breath." The notification control unit 52 may notify the surrounding area of ​​the vehicle of the possibility of dangerous driving via the communication unit 34 to mobile devices, such as smartphones, of people around the vehicle. The notification control unit 52 may also notify the surrounding area of ​​the vehicle of the possibility of dangerous driving using, for example, a horn, hazard lights, or a monitor or speaker (not shown) installed facing the exterior of the vehicle. Then, the process proceeds to step S28.

[0039] If the determination in step S20 is No, the dangerous driving determination unit 50 determines that there is no sign that the driver will engage in dangerous driving (step S26), and then proceeds to step S28.

[0040] If the determination in step S14 is No, if the determination in step S18 is No, after step S24, and after step S26, the control unit 36 ​​determines whether or not to end the process (step S28). Specifically, the control unit 36 ​​determines to end the process when an operation to end the process or an operation to turn off the power is received. If it is determined to end the process (step S28; Yes), the process in FIG. 2 ends. If it is not determined to end the process (step S28; No), the process proceeds to step S10.

[0041] As described above, the first embodiment determines whether a driver is about to engage in dangerous driving based on the timing when the driver's emotions change and the timing when it is determined that the vehicle is driving abnormally. For example, if the timing when the driver's anger worsens due to the behavior of another vehicle and the timing when the vehicle starts to suddenly accelerate or meander are almost the same, the first embodiment determines whether a driver is about to engage in dangerous driving. This allows the first embodiment to appropriately evaluate whether a driver is about to engage in dangerous driving.

[0042] In the first embodiment, when it is determined that there are signs that the driver will engage in dangerous driving, a notification is issued to the driver to encourage safe driving or to calm the driver. In the first embodiment, when it is determined that there are signs that the driver will engage in dangerous driving, a notification is issued to inform people outside the vehicle that the vehicle may engage in dangerous driving. In this way, the first embodiment can improve safety when it is determined that the driver will engage in dangerous driving.

[0043] [First Modification of the First Embodiment] In the first embodiment, after determining whether the emotion level is equal to or greater than a threshold, the driving evaluation device 10 determines whether the vehicle is driving abnormally. The driving evaluation device 10 may determine whether the emotion level is equal to or greater than a threshold after determining whether the vehicle is driving abnormally. In the example shown in FIG. 2, the processes of steps S12 and S14 may be interchanged with the processes of steps S16 and S18. For example, if the timing of the vehicle suddenly decelerating or maneuvering the steering wheel to accommodate another vehicle cutting in and the timing of the driver's worsening anger are approximately the same, a sign that the driver is driving dangerously may be determined. As a result, the first modification of the first embodiment can achieve the same effects as the first embodiment.

[0044] [Second Modification of the First Embodiment] In the first embodiment, the driving evaluation device 10 is described as being mounted on a general vehicle. However, the driving evaluation device 10 may be mounted on a bus, a taxi, or the like, for example.

[0045] When the driving evaluation device 10 is installed on a bus, a taxi, or the like, the notification control unit 52 may be configured to notify, for example, a bus company or a taxi company. This allows the bus company or taxi company to know whether there are any signs that the driver is about to engage in dangerous driving. This makes it possible for the modification of the first embodiment to be useful for educating employees at bus companies, taxi companies, and the like.

[0046] [Second embodiment] Next, a second embodiment of the present invention will be described.

[0047] (Driving evaluation device processing) The processing of the driving evaluation device according to the second embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing an example of the processing flow of the driving evaluation device according to the second embodiment. The configuration of the driving evaluation device according to the second embodiment is the same as that of the driving evaluation device 10 shown in Fig. 1, and therefore description thereof will be omitted.

[0048] The processes from step S40 to step S44 are the same as the processes from step S10 to step S14 shown in FIG. 2, respectively, and therefore will not be described here.

[0049] After determining Yes in step S44, the abnormal driving determination unit 48 sets a threshold value of the vehicle information for determining that abnormal driving is occurring, depending on the emotional level (step S46). Specifically, the abnormal driving determination unit 48 sets the threshold value so that, for example, the higher the emotional level, the more likely it is that abnormal driving is occurring. For example, when determining abnormal driving based on the distance to the preceding vehicle, the abnormal driving determination unit 48 sets the threshold value to 50 m when the emotional level is "medium" and to 80 m when the emotional level is "high". This makes it possible to issue a warning even when the risk level is low in the second embodiment. Then, the process proceeds to step S48.

[0050] The process of step S48 is the same as the process of step S16 shown in FIG. 2, and therefore a description thereof will be omitted.

[0051] After step S48, the abnormal driving determination unit 48 determines whether the vehicle is driving abnormally based on a threshold value set according to the emotional level of the driver (step S50). In the second embodiment, whether the vehicle is driving abnormally is determined based on a threshold value set according to the emotional level, so the higher the emotional level of the driver, the more likely it is that the vehicle is driving abnormally. If it is determined that the vehicle is driving abnormally (step S50; Yes), the process proceeds to step S52. If it is not determined that the vehicle is driving abnormally (step S50; No), the process proceeds to step S60.

[0052] The processes from step S52 to step S60 are the same as the processes from step S20 to step S28 shown in FIG. 2, respectively, and therefore will not be described here.

[0053] As described above, in the second embodiment, the threshold value of vehicle information for determining abnormal driving is set according to the emotional level of the driver, so that the higher the emotional level of the driver, the more likely it is to be determined that there are signs of dangerous driving. This allows the second embodiment to further improve safety.

[0054] [Third embodiment] Next, a third embodiment of the present invention will be described.

[0055] (Driving evaluation device processing) The processing of the driving evaluation device according to the third embodiment will be described with reference to Fig. 4. Fig. 4 is a flowchart showing an example of the processing flow of the driving evaluation device according to the third embodiment. The configuration of the driving evaluation device according to the third embodiment is the same as that of the driving evaluation device 10 shown in Fig. 1, and therefore description thereof will be omitted.

[0056] The processes from step S70 to step S74 are the same as the processes from step S10 to step S14 shown in FIG. 2, respectively, and therefore will not be described here.

[0057] After determining Yes in step S74, the emotion determination unit 46 determines whether the duration for which the driver's emotion level is equal to or greater than the threshold is a predetermined time or longer (step S76). If it is determined that the duration for which the emotion level is equal to or greater than the threshold is the predetermined time or longer (step S76; Yes), the process proceeds to step S78. If it is not determined that the duration for which the emotion level is equal to or greater than the threshold is the predetermined time or longer (step S76; No), the process proceeds to step S80.

[0058] If step S76 returns Yes, the abnormal driving determination unit 48 sets the threshold value of the vehicle information for determining that abnormal driving is occurring according to the duration for which an emotional level equal to or greater than the threshold value has continued (step S78). Specifically, the abnormal driving determination unit 48 sets the threshold value so that the longer the duration for which an emotional level equal to or greater than the threshold value has continued, the more likely it is that abnormal driving is occurring. For example, when determining abnormal driving based on the distance to the preceding vehicle, the abnormal driving determination unit 48 sets the threshold value to 50 m if the duration is "medium" and to 80 m if the duration is "high". This makes it possible to issue a warning even when the risk level is low in the third embodiment. Then, the process proceeds to step S82.

[0059] If the determination in step S76 is No, the abnormal driving determination unit 48 sets the threshold value of the vehicle information used to determine that the vehicle is driving abnormally to the initial value (step S80). In other words, the abnormal driving determination unit 48 does not change the threshold value of the vehicle information used to determine that the vehicle is driving abnormally. Then, the process proceeds to step S82.

[0060] The process of step S82 is the same as the process of step S16 shown in FIG. 2, and therefore a description thereof will be omitted.

[0061] After step S82, the abnormal driving determination unit 48 determines whether the vehicle is driving abnormally based on a threshold set according to the duration for which the driver's emotional level has been above the threshold (step S84). In the third embodiment, whether the vehicle is driving abnormally is determined based on a threshold set according to the duration for which the driver's emotional level has been above the threshold, so the longer the duration for which the driver's emotional level has been above the threshold, the more likely it is that the vehicle is driving abnormally. If it is determined that the vehicle is driving abnormally (step S84; Yes), the process proceeds to step S86. If it is not determined that the vehicle is driving abnormally (step S84; No), the process proceeds to step S94.

[0062] The processes from step S86 to step S94 are the same as the processes from step S20 to step S28 shown in FIG. 2, respectively, and therefore will not be described here.

[0063] As described above, in the third embodiment, the threshold value of the vehicle information for determining abnormal driving is set according to the duration for which the driver's emotional level is equal to or higher than the threshold value, so that the higher the driver's emotional level, the more likely it is to be determined that there are signs of dangerous driving. This allows the third embodiment to further improve safety.

[0064] [Fourth embodiment] Next, a fourth embodiment of the present invention will be described.

[0065] (Driving evaluation device processing) The processing of the driving evaluation device according to the fourth embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of the processing flow of the driving evaluation device according to the fourth embodiment. The configuration of the driving evaluation device according to the fourth embodiment is the same as that of the driving evaluation device 10 shown in Fig. 1, and therefore description thereof will be omitted.

[0066] The processes from step S100 to step S108 are the same as the processes from step S10 to step S18 shown in FIG. 2, respectively, and therefore will not be described here.

[0067] After the determination in step S108 is Yes, the dangerous driving determination unit 50 determines whether to change the determination conditions for determining that there is a sign of dangerous driving of the vehicle (step S110). Specifically, the dangerous driving determination unit 50 determines whether to change the predetermined time between the time when it is determined that the driver's emotional level, for determining that there is a sign of dangerous driving, is equal to or higher than a threshold level and the time when it is determined that the vehicle is driving abnormally. The dangerous driving determination unit 50 determines whether to change the determination conditions for determining that there is a sign of dangerous driving of the vehicle based on, for example, at least one of the degree of the driver's emotional level and the degree of abnormal driving. For example, when the driver's emotional level is determined to be "high," the dangerous driving determination unit 50 shortens the predetermined time between the time when it is determined that the emotional level is equal to or higher than a threshold level and the time when it is determined that the vehicle is driving abnormally. For example, when it is determined that the driver has performed a steering operation greater than a predetermined level, the dangerous driving determination unit 50 shortens the predetermined time between the time when it is determined that the emotional level is equal to or higher than a threshold level and the time when it is determined that the vehicle is driving abnormally. If it is determined that the determination conditions are to be changed (step S110; Yes), the process proceeds to step S112. If it is not determined that the determination conditions are to be changed (step S110; Yes), the process proceeds to step S114.

[0068] The dangerous driving determination unit 50 changes the timing for determining that there is a possibility of dangerous driving (step S112). Specifically, the dangerous driving determination unit 50 changes the predetermined time between the timing at which it is determined that the driver's emotional level for determining there is a possibility of dangerous driving is equal to or higher than a threshold level and the timing at which it is determined that the vehicle is traveling abnormally, according to the determination result of step S110. Then, the process proceeds to step S114.

[0069] The processes from step S114 to step S122 are the same as the processes from step S20 to step S28 shown in FIG. 2, respectively, and therefore will not be described here.

[0070] As described above, the fourth embodiment changes the timing for determining whether the driving is dangerous based on at least one of the driver's emotional level and the degree of abnormal driving. This allows the fourth embodiment to set an appropriate timing according to the driver's emotional level and the degree of abnormal driving, thereby further improving safety.

[0071] [Modification of the fourth embodiment] In the fourth embodiment, the timing for determining whether or not the driving is dangerous is changed based on at least one of the driver's emotional level and the degree of abnormal driving. The driving evaluation device 10 may change the timing for determining whether or not the driving is dangerous based on at least one of the duration of the driver's emotional level and the degree of abnormal driving. In the example shown in FIG. 5, instead of the processing of step S110, it is determined whether or not the duration for which the driver's emotional level is equal to or greater than a threshold is a predetermined time or longer. If it is determined that the duration for which the emotional level is equal to or greater than the threshold is the predetermined time or longer, the timing for determining whether or not the driving is dangerous is changed. If it is not determined that the duration for which the emotional level is equal to or greater than the threshold is the predetermined time or longer, the timing for determining whether or not the driving is dangerous is maintained. As a result, the modified fourth embodiment can achieve the same effects as the fourth embodiment.

[0072] Although the embodiments of the present invention have been described above, the present invention is not limited to the contents of these embodiments. Furthermore, the above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-described components can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments. [Explanation of symbols]

[0073] 10 Driving evaluation device 20 Imaging unit 22 Biometric Sensors 24 Input section 26 Display section 28 Audio output section 30 Storage section 32 CAN interface section 34 Communications Department 36 Control unit (driving evaluation control unit) 40 Video data acquisition unit 42 Biometric information acquisition unit 44 Vehicle information acquisition unit 46 Emotion Judgment Department 48 Abnormal driving detection unit 50 Dangerous driving judgment unit 52 Notification control unit

Claims

1. a video data acquisition unit that acquires video data that is a video of a driver of the vehicle; an emotion determination unit that estimates an emotion level of the driver based on the video data and determines whether the estimated emotion level is equal to or greater than a threshold level; a vehicle information acquisition unit that acquires vehicle information indicating a behavior of the vehicle; an abnormal driving determination unit that determines that the vehicle is driving abnormally when at least one of the following occurs: the speed of the vehicle exceeds a first threshold value; the acceleration of the vehicle exceeds a second threshold value; the steering operation amount of the vehicle exceeds a third threshold value; the accelerator operation amount of the vehicle exceeds a fourth threshold value; and the distance between the vehicle and another vehicle traveling nearby exceeds a fifth threshold value; a dangerous driving determination unit that, when it is determined that the emotion level is equal to or greater than the threshold level and it is determined that the vehicle is driving abnormally, determines whether the driver is driving dangerously based on the timing at which it was determined that the emotion level is equal to or greater than the threshold level and the timing at which it was determined that the vehicle is driving abnormally; Equipped with the abnormal driving determination unit changes at least one of the first threshold, the second threshold, the third threshold, the fourth threshold, and the fifth threshold in a direction that makes it more likely that the vehicle is being determined to be driving abnormally as the duration over which the emotion level is determined to be equal to or higher than the threshold level becomes longer. Driving evaluation control device.

2. The abnormal driving determination unit changes at least one of the first threshold, the second threshold, the third threshold, the fourth threshold, and the fifth threshold in multiple stages depending on the duration for which the emotional level is determined to be equal to or higher than the threshold level. The driving evaluation control device according to claim 1 .

3. acquiring video data, the video being a video of a driver of the vehicle; a step of estimating an emotion level of the driver based on the video data and determining whether the estimated emotion level is equal to or greater than a threshold level; acquiring vehicle information indicating a behavior of the vehicle; determining that the vehicle is traveling abnormally when at least one of the following occurs: the speed of the vehicle exceeds a first threshold; the acceleration of the vehicle exceeds a second threshold; the steering operation amount of the vehicle exceeds a third threshold; the accelerator operation amount of the vehicle exceeds a fourth threshold; and the distance between the vehicle and another vehicle traveling nearby exceeds a fifth threshold; When the emotion level is determined to be equal to or greater than the threshold level and the vehicle is determined to be driving abnormally, determining whether the driver is about to engage in dangerous driving based on the timing at which the emotion level is determined to be equal to or greater than the threshold level and the timing at which the vehicle is determined to be driving abnormally; Including, In the step of determining that the vehicle is traveling abnormally, at least one of the first threshold value, the second threshold value, the third threshold value, the fourth threshold value, and the fifth threshold value is changed in a direction that makes it more likely that the vehicle is traveling abnormally as the duration during which the emotion level is determined to be equal to or higher than the threshold level becomes longer. Driving evaluation control method.

Images