Driving evaluation control device, and driving evaluation control method
The driving evaluation control device and method address the challenge of evaluating abnormal driving by estimating emotional levels and monitoring vehicle behavior to prevent accidents through adaptive threshold adjustments and notifications.
Patent Information
- Application Number
- JP2025143370
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-08-29
- Publication Date
- 2025-10-30
- Estimated Expiration
- 2041-06-25
AI Technical Summary
Existing technologies fail to appropriately evaluate abnormal driving behaviors caused by changes in a driver's emotions, which can lead to accidents.
A driving evaluation control device and method that estimates the driver's emotional level using video and biometric data, monitors vehicle behavior, and adjusts thresholds based on emotional duration and intensity to determine abnormal driving, providing notifications to prevent dangerous situations.
Effectively evaluates and prevents abnormal driving by adjusting thresholds based on emotional duration and intensity, improving safety by alerting drivers and potentially others to dangerous driving conditions.
Smart Images

Figure 2025164910000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a driving evaluation control device and a driving evaluation control method. [Background technology]
[0002] A technology has been disclosed that observes the behavior of a vehicle and determines the possibility of dangerous driving (for example, For example, see Patent Document 1. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2020-102092 Summary of the Invention [Problem to be solved by the invention]
[0004] When a driver's emotions change, such as when they become irritated, they may engage in so-called abnormal driving, such as tailgating or intentionally cutting in. Abnormal driving may lead to accidents involving their own vehicle or other vehicles. Therefore, it is desirable to appropriately evaluate such abnormal driving.
[0005] An object of the present invention is to provide a driving evaluation control device and a driving evaluation control method that can appropriately evaluate abnormal driving. [Means for solving the problem]
[0006] The driving evaluation control device according to the present invention comprises an emotion determination unit that estimates the emotional level of the driver of the vehicle based on video data of the driver or biometric information of the driver and determines whether the estimated emotional level is equal to or higher than a threshold level; a vehicle information acquisition unit that acquires vehicle information indicating the behavior of the vehicle; and an abnormal driving determination unit that determines that the vehicle is driving abnormally when at least one of the following occurs: the vehicle speed exceeds a first threshold, the vehicle acceleration exceeds a second threshold, the vehicle steering operation amount exceeds a third threshold, the vehicle accelerator operation amount exceeds a fourth threshold, or the inter-vehicle distance to another vehicle traveling in the vicinity exceeds a fifth threshold. The abnormal driving determination unit changes at least one of the first threshold, second threshold, third threshold, fourth threshold, and fifth threshold so that the longer the duration for which the emotional level is determined to be equal to or higher than the threshold level, the more likely it is that the vehicle is being determined to be driving abnormally.
[0007] The driving evaluation control method according to the present invention is carried out by a computer and includes steps including: an emotion determination step of inferring the emotional level of the vehicle driver based on video data of the vehicle driver or biometric information of the driver and determining whether the inferred emotional level is equal to or greater than a threshold level; a vehicle information acquisition step of acquiring vehicle information indicating the behavior of the vehicle; and an abnormal driving determination step of determining that the vehicle is driving abnormally when at least one of the following occurs: the vehicle speed exceeds a first threshold, the vehicle acceleration exceeds a second threshold, the vehicle steering operation amount exceeds a third threshold, the vehicle accelerator operation amount exceeds a fourth threshold, or the inter-vehicle distance to another vehicle traveling in the vicinity exceeds a fifth threshold. The abnormal driving determination step changes at least one of the first threshold, the second threshold, the third threshold, the fourth threshold, and the fifth threshold so that the longer the duration for which the emotional level is determined to be equal to or greater than the threshold level, the more likely it is that the vehicle is driving abnormally. [Effects of the Invention]
[0008] According to the present invention, abnormal driving can be appropriately evaluated. [Brief explanation of the drawings]
[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a driving evaluation device according to the first embodiment. [Figure 2] FIG. 2 is a flowchart showing an example of the flow of processing performed by the driving evaluation device according to the first embodiment. [Figure 3] FIG. 3 is a flowchart showing an example of the flow of processing performed by the driving evaluation device according to the second embodiment. [Figure 4] FIG. 4 is a flowchart showing an example of the flow of processing performed by the driving evaluation device according to the third embodiment. [Figure 5] FIG. 5 is a flowchart showing an example of the flow of processing performed by the driving evaluation device according to the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. The present invention is not limited to the embodiment, and in the following embodiments, the same parts may be used. The same symbols are used for the units to avoid redundant explanation.
[0011] [First embodiment] (Driving evaluation device) An example of the configuration of a driving evaluation device according to the first embodiment will be described with reference to FIG. 1 is a block diagram showing an example of the configuration of a driving evaluation device according to a first embodiment;
[0012] As shown in FIG. 1, the driving evaluation device 10 includes an imaging unit 20, a biosensor 22, and an input unit 2. 4, a display unit 26, an audio output unit 28, a memory unit 30, and a CAN (Controller Area Network a working interface unit 32, a communication unit 34, and a control unit (driving evaluation control device) 36; The driving evaluation device 10 is mounted on a vehicle. It may be a device that is installed on the vehicle or a portable device that can be used in a vehicle. The driving evaluation device 10 is configured to determine the timing at which the emotion level of the driver of the vehicle changes and the timing at which the vehicle Based on the timing of abnormal driving, the driver's signs of dangerous driving are evaluated.
[0013] The imaging unit 20 is a camera that is arranged facing the interior of the vehicle and captures images of the interior of the vehicle. The imaging unit 20 captures, for example, at least the facial expression of the driver of the vehicle. For example, the imaging unit 20 is configured with a wide-angle camera capable of capturing an image in a range of about 180 degrees. For example, the imaging unit 20 may be configured with a group of multiple cameras. The image capturing unit 20 may be configured as a vehicle interior camera, or may be configured as a visible light camera. The device may have a microphone for picking up the sound.
[0014] The biosensor 22 is a sensor that detects biometric information of the driver of the vehicle. For example, but not limited to, the positioning may be on the steering wheel or the driver's seat. The biometric sensor 22 detects biometric information of the driver of the vehicle at predetermined intervals, for example. The biological sensor 22 may be, for example, a pulse sensor, a blood pressure sensor, a body temperature sensor, It consists of a sweat sensor, an EEG sensor, a cerebral blood flow sensor, and a breathing sensor, but other The device may be configured with a sensor that detects the biological information.
[0015] The input unit 24 receives various operations for the driving evaluation device 10. For example, the input unit 24 For example, it is composed of various input devices such as buttons, switches, and touch panels.
[0016] The display unit 26 displays various images. For example, the display unit 26 displays a warning that the driver is driving dangerously. If it is determined that there is a sign of a crash, it functions as a warning unit that displays an image to alert the driver. The display unit 26 is, for example, a liquid crystal display (LCD). , organic EL (Electro-Luminescence), or head-up displays It's a spray.
[0017] The audio output unit 28 outputs various sounds. For example, the audio output unit 28 outputs various sounds to alert the driver to danger. a notification unit that outputs a voice to warn the driver when it is determined that there is a sign of dangerous driving; The audio output unit 28 may be configured, for example, by a speaker mounted on the vehicle. do.
[0018] The storage unit 30 is a memory that stores various types of information. The storage unit 30 stores the calculation contents of the program 6 and information such as the program. Random Access Memory (RAM), main memory such as ROM (Read Only Memory), HDD and an external storage device such as a hard disk drive (D).
[0019] The CAN interface unit 32 is an interface for acquiring various vehicle information via the CAN. The vehicle information includes, for example, the engine operating status, the vehicle running status, It contains information such as the distance to the preceding vehicle detected by a distance measuring sensor (not shown). do.
[0020] The communication unit 34 transmits and receives data to and from an external device. It transmits and receives data between the smartphones and other devices of people around it. The unit 34 is, for example, a communication device that is connected to a network using Wi-Fi (registered trademark) and Bluetooth (registered trademark). How it is configured to communicate.
[0021] The control unit 36 controls the operation of each unit of the driving evaluation device 10. For example, the control unit 36 By using PU (Central Processing Unit) and MPU (Micro Processing Unit), When a program stored in the storage unit 30 or the like is executed using the RAM or the like as a work area, The control unit 36 is realized, for example, by an ASIC (Application Specific Integrated Circuit This is realized by integrated circuits such as FPGAs (Field Programmable Gate Arrays) and FPGAs. The control unit 36 may be realized by a combination of hardware and software. good.
[0022] The control unit 36 includes a video data acquisition unit 40, a biometric information acquisition unit 42, and a vehicle information acquisition unit 44. a feeling determination unit 46, an abnormal driving determination unit 48, a dangerous driving determination unit 50, and a notification control unit 52 And, it is equipped with.
[0023] The video data acquisition unit 40 acquires video data from the imaging unit 20. 0 is, for example, an image obtained by capturing the driver's facial expression, complexion, facial temperature, and line of sight from the image capturing unit 20. Image data is acquired.
[0024] The biometric information acquisition unit 42 acquires biometric information of the vehicle driver from the biometric sensor 22. The information acquisition unit 42 may be, for example, a wearable device (not shown) worn by a driver of a vehicle. The pulse, heart rate, blood pressure, body temperature, sweating, brain waves, cerebral blood flow, respiratory rate, etc. of the driver of the vehicle are recorded from the Biometric information may also be acquired.
[0025] The vehicle information acquisition unit 44 acquires various vehicle conditions, For example, status information indicating the vehicle's status, such as speed, acceleration, steering angle, and accelerator opening, At least one of the driving operation information indicating the driving operation of the driver, such as the operation amount of the brake and accelerator The vehicle information acquisition unit 44 acquires vehicle information indicating the behavior of the vehicle, including the direction of travel. The vehicle is equipped with an acceleration sensor (not shown) that senses the vehicle's state and measures the distance to other vehicles and objects around the vehicle. Vehicle information may be acquired from various sensors such as a distance sensor.
[0026] The emotion determination unit 46 determines an emotion level that indicates the degree of emotion of the driver of the vehicle. The determining unit 46 determines the driver's The type and level of emotion are estimated, and whether the estimated emotion level is above a threshold level or not. The emotion determination unit 46 recognizes the facial expression of the driver using image recognition technology, for example. In addition, the emotion determination unit 46 determines the level of emotion from, for example, facial expressions. The emotion determination unit 4 may estimate the emotion level and determine whether the emotion level is equal to or higher than a predetermined level. 6. For example, if the image processing technology determines that the driver is flushed, the driver may be considered excited. The emotion determination unit 46 may estimate that the biological information acquired by the biological information acquisition unit 42 is For example, if the driver's emotional level exceeds a threshold level, for example, a sudden increase in pulse rate or a change in brain waves may be detected. In this embodiment, the emotion determination unit 46 determines whether the emotion type is mainly anger. Determine the intensity of emotion when expressing excitement or arousal.
[0027] The abnormal driving determination unit 48 determines whether the vehicle is abnormal based on the vehicle information acquired by the vehicle information acquisition unit 44. The abnormal driving determination unit 48 determines whether the vehicle is driving normally. When the vehicle is traveling at a speed or acceleration that exceeds a predetermined threshold, or when the steering wheel is When the amount of operation or accelerator pedal operation is the amount of operation, the distance between the vehicle and other vehicles traveling in the vicinity is determined to be within a predetermined threshold. If the value is exceeded, the vehicle is driving abnormally, such as snaking, suddenly starting, or tailgating. It is determined that:
[0028] The dangerous driving determination unit 50 determines whether the driver of the vehicle is about to engage in dangerous driving. For example, the unit 50 may determine the timing at which the emotion level of the driver is determined to be equal to or higher than the threshold level and the timing at which the vehicle Based on the timing when it is determined that both vehicles are driving abnormally, the driver of the vehicle Determine signs of rotation.
[0029] The notification control unit 52 executes notification processing. If it is determined that both drivers are showing signs of dangerous driving, the driver of the vehicle and a few people outside the vehicle will be informed. The notification process is executed for at least one of them.
[0030] (Driving evaluation device processing) The process of the driving evaluation device according to the first embodiment will be described with reference to FIG. 3 is a flowchart showing an example of a processing flow of the driving evaluation device according to the embodiment.
[0031] The video data acquisition unit 40 acquires video data (step S10). The image data acquisition unit 40 acquires, for example, image data of the driver's facial expression from the imaging unit 20. Then, the process proceeds to step S12.
[0032] The emotion determination unit 46 determines the emotion of the driver (step S12). The determining unit 46 determines whether or not the driver's facial expression is correct based on the video data of the driver's facial expression acquired by the video data acquiring unit 40. The type and intensity of the driver's emotions, such as joy, anger, sadness, fun, and excitement. The emotion determination unit 46 determines the type and the emotion of the driver using, for example, a known method. In the embodiment, the emotion determination unit 46 determines the degree of emotion intensity. The strength of the emotion, such as anger or excitement, is determined, and the process then proceeds to step S14.
[0033] The emotion determination unit 46 determines whether the emotion level indicating the degree of the driver's emotion is equal to or greater than a threshold value. Specifically, the emotion determination unit 46 determines whether the driver is Based on facial expression video data, the driver's eyes, mouth, and gestures are analyzed to determine the driver's The emotional level of the person is classified into three levels: "low," "medium," and "high." For example, the determination unit 46 determines whether the driver's emotional level is "medium" or higher among "low," "medium," and "high." The emotion determination unit 46 calculates the emotion level of the driver as a numerical value, for example. Then, it may be determined whether the calculated value is equal to or greater than a predetermined threshold value. If it is determined that the value is equal to or greater than the threshold value (step S14; Yes), the process proceeds to step S16. If it is not determined that the emotion level is equal to or greater than the threshold (step S14; No), Proceed to step S28.
[0034] If the determination in step S14 is Yes, the vehicle information acquisition unit 44 acquires the vehicle information. Specifically, the vehicle information acquisition unit 44 acquires information, for example, from the CAN interface. Vehicle information is acquired from the interface unit 32. Then, the process proceeds to step S18.
[0035] The abnormal driving determination unit 48 determines whether the vehicle is driving abnormally (step S1 8) Specifically, the abnormal driving determination unit 48 determines that the vehicle is abnormal when the vehicle information is equal to or greater than a threshold value. More specifically, the abnormal driving determination unit 48 determines that the vehicle is driving normally. When the speed or acceleration of the vehicle increases above a certain level, or when the steering operation amount or actuation amount exceeds a predetermined threshold, When the distance between the vehicle and other vehicles is less than a predetermined distance, If the distance changes to a shorter distance, it is determined that the vehicle is driving abnormally. If it is determined that the vehicle is running abnormally (step S18; Yes), the process proceeds to step S20. If it is not determined that the information is correct (step S18; No), the process proceeds to step S28.
[0036] If the determination in step S18 is Yes, the dangerous driving determination unit 50 determines the driver's emotional level. The timing when the vehicle is judged to be above the threshold and the timing when the vehicle is judged to be driving abnormally Specifically, it is determined whether or not it is a predetermined timing (step S20). The driving determination unit 50 determines whether the driver's emotion level is equal to or higher than the threshold value and whether the vehicle is moving in a different direction. It is determined whether the time between the timing at which the vehicle is determined to be in normal driving is equal to or less than a predetermined time. The predetermined time is, for example, about 1 to 10 seconds, but is not limited to this. The timing when the emotion level is judged to be above the threshold and the timing when the vehicle is judged to be driving abnormally If it is determined that the timing is the predetermined timing (step S20; Yes), The process proceeds to step S22. The timing at which the vehicle is determined to be running abnormally is not determined to be the predetermined timing. If so (step S20; No), proceed to step S26.
[0037] If the determination in step S20 is Yes, the dangerous driving determination unit 50 determines whether the driver is driving dangerously. That is, the dangerous driving determination unit 50 determines that there is a sign that the driver will The timing when the driver's emotional level is judged to be above the threshold and the timing when the vehicle is judged to be driving abnormally are If the time between the time the driver received the warning and the time the driver received the warning is less than a predetermined time, the driver is likely to engage in dangerous driving. Then, the process proceeds to step S24.
[0038] The notification control unit 52 executes the notification process (step S24). 52, for example, executes a notification process for at least one of the inside of the vehicle and the surroundings of the vehicle. Specifically, the notification control unit 52 controls the audio output unit 28 to output a message such as "Drive safely." Please keep this in mind." A voice message is output to encourage the driver to drive safely. The unit 52 controls the audio output unit 28 to output, for example, "Calm down and relax. "Please take a deep breath," etc. The notification control unit 52 may, for example, notify the surroundings of the vehicle via the communication unit 34. There is a possibility that the vehicle may be driving dangerously in response to the smartphones and other mobile devices of people around you. The notification control unit 52 notifies the surroundings of the vehicle by, for example, honking the horn, The system uses a monitor and speaker (not shown) installed facing the outside of the vehicle. The system may notify the driver that the vehicle may be driving recklessly. Then, the system proceeds to step S28. .
[0039] If the determination in step S20 is No, the dangerous driving determination unit 50 determines whether the driver is driving dangerously. It is determined that there is no sign of this happening (step S26), and the process then proceeds to step S28.
[0040] If the determination in step S14 is No, or if the determination in step S18 is No, After step S24 and after step S26, the control unit 36 determines whether or not to end the process. Specifically, the control unit 36 receives an operation to end the process and determines whether or not the process is completed (step S28). When a command to turn off the power is received, the process is determined to be finished. If it is determined that the process should be ended (step S28; Yes), the process of FIG. 2 is ended. If it is not determined that the process should be ended (step S28; No), the process proceeds to step S10.
[0041] As described above, in the first embodiment, the timing when the driver's emotions change and the timing when the vehicle is running abnormally are determined. Based on the timing at which the driver is judged to be driving dangerously, the system determines whether the driver is driving dangerously. For example, when the driver's anger worsens due to the behavior of other vehicles, When the timing of the vehicle suddenly accelerating or snaking is almost the same as the timing of the accident, The first embodiment determines whether the driver is driving dangerously. It is possible to properly evaluate the signs of a rotation.
[0042] In the first embodiment, when it is determined that the driver has a sign of dangerous driving, The first embodiment provides a notification to encourage safe driving and calm the driver. If it is determined that the driver is showing signs of dangerous driving, the driver will be informed of the possibility of dangerous driving to the outside of the vehicle. In this way, in the first embodiment, the driver is informed of the possibility of dangerous driving. This can improve safety when it is determined that the above should be performed.
[0043] [First Modification of the First Embodiment] In the first embodiment, after determining whether the emotion level is equal to or greater than the threshold, the vehicle is detected as being abnormally running. The driving evaluation device 10 determines whether the vehicle is driving abnormally. After determining whether the emotion level is equal to or greater than a threshold, it may be determined whether the emotion level is equal to or greater than a threshold. In other words, the processes in steps S12 and S14 and steps S16 and S17 are For example, if a vehicle is in a situation where it is necessary to respond to the cut-in of another vehicle, the process of S18 may be replaced with the process of S19. The timing of sudden deceleration or steering and the timing when the driver's anger worsened When this happens almost simultaneously, the system determines whether the driver is driving dangerously. Therefore, the first modified example of the first embodiment can obtain the same effects as the first embodiment.
[0044] [Second Modification of the First Embodiment] In the first embodiment, the driving evaluation device 10 is described as being mounted on a general vehicle. The driving evaluation device 10 may be mounted on, for example, a bus or a taxi.
[0045] When the driving evaluation device 10 is mounted on a bus, a taxi, or the like, the notification control unit 52 may, for example, In this way, the information may be sent to bus companies or taxi companies. For example, bus and taxi companies can identify whether or not a driver is showing signs of dangerous driving. As a result, the modified example of the first embodiment can be used by bus companies, taxi companies, etc. This can be useful for employee education.
[0046] [Second embodiment] Next, a second embodiment of the present invention will be described.
[0047] (Driving evaluation device processing) The process of the driving evaluation device according to the second embodiment will be described with reference to FIG. 10 is a flowchart showing an example of a processing flow of the driving evaluation device according to the second embodiment. The configuration of the driving evaluation device according to the embodiment is the same as that of the driving evaluation device 10 shown in FIG. The details are omitted.
[0048] The processes in steps S40 to S44 are respectively the same as those in steps S10 to S44 shown in FIG. Since this is the same processing as step S14, the explanation will be omitted.
[0049] After the determination in step S44 is "Yes," the abnormal driving determination unit 48 determines whether the vehicle is driving abnormally. The threshold value of the vehicle information for determining that the driver is in a state of emotional distress is set according to the emotion level (step S46). For example, the abnormal driving determination unit 48 determines that the higher the emotion level, the more abnormal driving is being performed. The abnormal driving determination unit 48 determines the abnormal driving state based on, for example, the distance to the preceding vehicle. When determining abnormal driving based on the distance, the threshold is set to 50m if the emotion level is "medium." If the emotion level is "high", the threshold is set to 80m. In this mode, it is possible to notify the driver when the risk is still low. Proceed to.
[0050] The process in step S48 is the same as the process in step S16 shown in FIG. 2, so the explanation will be omitted. is omitted.
[0051] After step S48, the abnormal driving determination unit 48 determines whether the abnormal driving is occurring or not, based on the emotional level of the driver. Based on the threshold value, it is determined whether the vehicle is running abnormally (step S50). In the second embodiment, whether or not the driving is abnormal is determined based on a threshold set according to the emotion level. Therefore, the higher the driver's emotional level, the more likely it is that the driving is abnormal. If it is determined that both vehicles are running abnormally (step S50; Yes), step S5 If it is not determined that the vehicle is running abnormally (step S50; No), ), proceed to step S60.
[0052] The processes from step S52 to step S60 are respectively the same as steps S20 to S60 shown in FIG. Since this is the same processing as step S28, the explanation will be omitted.
[0053] As described above, in the second embodiment, abnormal driving is determined according to the emotional level of the driver. By setting a threshold for vehicle information, the higher the driver's emotional level, the more likely they are to engage in dangerous driving. As a result, the second embodiment can further improve safety. can be done.
[0054] [Third embodiment] Next, a third embodiment of the present invention will be described.
[0055] (Driving evaluation device processing) The process of the driving evaluation device according to the third embodiment will be described with reference to FIG. 10 is a flowchart showing an example of a processing flow of the driving evaluation device according to the third embodiment. The configuration of the driving evaluation device according to the embodiment is the same as that of the driving evaluation device 10 shown in FIG. The details are omitted.
[0056] The processes in steps S70 to S74 are respectively the same as those in steps S10 to S74 shown in FIG. Since this is the same processing as step S14, the explanation will be omitted.
[0057] After the determination in step S74 is "Yes," the emotion determination unit 46 determines whether the driver's emotion level is below a threshold. It is determined whether the duration that is equal to or greater than the value is equal to or greater than a predetermined time (step S76). If it is determined that the duration during which the level is equal to or higher than the threshold is equal to or longer than the predetermined time (step S7 6; Yes), proceed to step S78. If it is not determined that it is equal to or greater than that (step S76; No), the process proceeds to step S80.
[0058] If the determination in step S76 is Yes, the abnormal driving determination unit 48 determines whether abnormal driving is occurring. The threshold for vehicle information used to determine whether an emotion level is above the threshold is set according to the duration of the emotion level. Specifically, the abnormal driving determination unit 48 determines whether the driver is experiencing an emotion equal to or greater than a threshold value, for example. The longer the level continues, the more likely it is to be determined that the driver is driving abnormally. The abnormal driving determination unit 48 determines abnormal driving based on the distance to the preceding vehicle, for example. When determining whether a given duration is "medium," the threshold is set to 50m, and when the duration is "high," the threshold is set to 50m. In this case, the threshold value is set to 80 m. Then, the process proceeds to step S82.
[0059] If the determination in step S76 is No, the abnormal driving determination unit 48 determines whether abnormal driving is occurring. The threshold value of the vehicle information for determining that the vehicle is in a different state is set to an initial value (step S80). The normal driving determination unit 48 does not change the threshold value of the vehicle information for determining that the vehicle is driving abnormally. Then, the process proceeds to step S82.
[0060] The process of step S82 is the same as the process of step S16 shown in FIG. 2, so the explanation will be omitted. is omitted.
[0061] After step S82, the abnormal driving determination unit 48 determines whether the driver's emotion level remains above the threshold. Based on the threshold set according to the duration of the accident, it is determined whether the vehicle is driving abnormally. In the third embodiment, if the driver's emotion level continues to be equal to or higher than the threshold, the driver is determined to be at a high level (step S84). In order to determine whether or not the driving is abnormal based on a threshold set according to the duration of the driving The longer the emotional level of the driver remains above the threshold, the more likely it is that the driver is being judged as abnormal driving. If it is determined that the vehicle is running abnormally (step S84; Yes), If it is determined that the vehicle is not running abnormally (step S86), S84; No), proceed to step S94.
[0062] The processes in steps S86 to S94 are respectively the same as those in steps S20 to S94 shown in FIG. Since this is the same processing as step S28, the explanation will be omitted.
[0063] As described above, in the third embodiment, the driver's emotion level is set to a value equal to or greater than the threshold value for a period of time. By setting a threshold value for vehicle information that is judged as abnormal driving, the driver's emotional level can be The higher the value, the more likely it is that a sign of dangerous driving will occur. , safety can be further improved.
[0064] [Fourth embodiment] Next, a fourth embodiment of the present invention will be described.
[0065] (Driving evaluation device processing) The processing of the driving evaluation device according to the fourth embodiment will be described with reference to FIG. 10 is a flowchart showing an example of a processing flow of the driving evaluation device according to the fourth embodiment. The configuration of the driving evaluation device according to the embodiment is the same as that of the driving evaluation device 10 shown in FIG. The details are omitted.
[0066] The processes from step S100 to step S108 are respectively the same as those of step S1 shown in FIG. Since this is the same processing as that in steps S10 to S18, the explanation will be omitted.
[0067] After the determination in step S108 is "Yes," the dangerous driving determination unit 50 determines whether the vehicle is being driven dangerously. It is determined whether or not to change the determination conditions for determining that there is a sign of Specifically, the dangerous driving determination unit 50 determines whether there is a sign of dangerous driving. The timing when the driver's emotional level is judged to be above the threshold level and the timing when the vehicle is driving abnormally are The system determines whether to change the predetermined time between the timing at which it is determined that the driver is driving dangerously. The determination unit 50 determines, for example, at least the degree of the driver's emotional level and the degree of abnormal driving. The determination conditions for determining that there is a sign of dangerous driving of the vehicle are changed based on the other one. The dangerous driving determination unit 50 determines the driver's emotional level in three stages, for example. When determining the emotion level, if the emotion level is "high", the emotion level is determined to be above the threshold level. and the time when it is determined that the vehicle is running abnormally. The dangerous driving determination unit 50 determines, for example, that the driver has performed a steering operation that is greater than or equal to a predetermined value. In this case, the timing when the emotion level is judged to be above the threshold level and the timing when the vehicle is driving abnormally are recorded. The predetermined time between the timing at which it is determined that the operation is being performed and the timing at which it is determined that the operation is being performed is shortened. If it is determined that the condition is not satisfied (step S110; Yes), the process proceeds to step S112. If it is not determined that the change should be made (step S110; Yes), the process proceeds to step S114.
[0068] The dangerous driving determination unit 50 changes the timing for determining that there is a possibility of dangerous driving. Specifically, the dangerous driving determination unit 50 determines whether the driver is likely to engage in dangerous driving. The timing when the driver's emotional level is judged to be equal to or higher than the threshold level for judging that there is a possibility of The predetermined time between the timing when the vehicle is determined to be running abnormally and the timing when the vehicle is determined to be running abnormally is set to a step The change is made according to the result of the determination in S110, and the process then proceeds to step S114.
[0069] The processes from step S114 to step S122 are respectively the same as step S2 shown in FIG. The process is the same as that from step S28, so the explanation will be omitted.
[0070] As described above, the fourth embodiment is based on at least a correlation between the driver's emotional level and the degree of abnormal driving. The timing for determining whether or not the driving is dangerous is changed based on either one of the two. The fourth embodiment is based on the driver's emotional level and the appropriate timing according to the degree of abnormal driving. This allows for the setting of a lock, further improving safety.
[0071] [Modification of the fourth embodiment] In the fourth embodiment, the vehicle speed is determined based on at least one of the driver's emotional level and the degree of abnormal driving. Based on this, the timing for determining whether the driving is dangerous or not has been changed. Based on at least one of the duration of the driver's emotional level and the degree of abnormal driving, The timing for determining whether the driver is driving dangerously may be changed. Instead of the processing of step S110, the duration during which the driver's emotion level is equal to or higher than the threshold is determined as a predetermined time. If the duration of the emotion level being above the threshold is greater than or equal to a predetermined time, the If it is determined that the driver is driving dangerously, the timing for determining whether the driver is driving dangerously is changed. If it is determined that the duration for which the bell is equal to or greater than the threshold is not equal to or greater than the predetermined time, it is determined that the driver is driving dangerously. The timing for determining whether or not the fourth embodiment is performed is maintained. The same effects as those of the embodiment can be obtained.
[0072] Although the embodiments of the present invention have been described above, the present invention is not limited to the contents of these embodiments. In addition, the above-mentioned components include those that can be easily imagined by a person skilled in the art and those that are substantially Furthermore, the above-mentioned components are appropriately Furthermore, the present invention can be configured in a manner that does not deviate from the spirit of the above-described embodiments. Various omissions, substitutions or modifications of components may be made. [Explanation of symbols]
[0073] 10 Driving evaluation device 20 Imaging unit 22 Biometric Sensors 24 Input section 26 Display section 28 Audio output section 30 Storage section 32 CAN interface section 34 Communications Department 36 Control unit (driving evaluation control unit) 40 Video data acquisition unit 42 Biometric information acquisition unit 44 Vehicle information acquisition unit 46 Emotion Judgment Department 48 Abnormal driving detection unit 50 Dangerous driving judgment unit 52 Notification control unit
Claims
1. an emotion determination unit that estimates an emotion level of the driver of the vehicle based on video data of the driver or biological information of the driver, and determines whether the estimated emotion level is equal to or greater than a threshold level; a vehicle information acquisition unit that acquires vehicle information indicating a behavior of the vehicle; an abnormal driving determination unit that determines that the vehicle is driving abnormally when at least one of the following occurs: the speed of the vehicle exceeds a first threshold value; the acceleration of the vehicle exceeds a second threshold value; the steering operation amount of the vehicle exceeds a third threshold value; the accelerator operation amount of the vehicle exceeds a fourth threshold value; and the distance between the vehicle and another vehicle traveling nearby exceeds a fifth threshold value; Equipped with the abnormal driving determination unit changes at least one of the first threshold, the second threshold, the third threshold, the fourth threshold, and the fifth threshold in a direction that makes it more likely that the vehicle is being determined to be driving abnormally as the duration over which the emotion level is determined to be equal to or higher than the threshold level becomes longer. Driving evaluation control device.
2. an emotion determination step of estimating an emotion level of the driver of the vehicle based on video data of the driver or biological information of the driver, and determining whether the estimated emotion level is equal to or higher than a threshold level; a vehicle information acquisition step of acquiring vehicle information indicating a behavior of the vehicle; an abnormal driving determination step of determining that the vehicle is driving abnormally when at least one of the following occurs: the speed of the vehicle exceeds a first threshold value; the acceleration of the vehicle exceeds a second threshold value; the steering operation amount of the vehicle exceeds a third threshold value; the accelerator operation amount of the vehicle exceeds a fourth threshold value; and the distance between the vehicle and another vehicle traveling nearby exceeds a fifth threshold value; An abnormal driving determination method that executes the abnormal driving determination step changes at least one of the first threshold value, the second threshold value, the third threshold value, the fourth threshold value, and the fifth threshold value in a direction that makes it more likely that the vehicle is being determined to be driving abnormally as the duration during which the emotion level is determined to be equal to or higher than the threshold level becomes longer. Driving evaluation control method.
Citation Information
Patent Citations
Auxiliary driving method, device and equipment and storage medium
CN112277955A
Vehicle controller
JP2008062852A
Operator condition detection system and operator condition detection method
JP2018075208A
Information processing device, information processing method, and program
JP2018180983A
Driving advice device and driving advice method
JP2019098780A