Vehicle control device, vehicle control method, and vehicle control program

Abstract

To provide a vehicle control device, a vehicle control method, and a vehicle control program capable of achieving safety of traveling of a vehicle against abnormality of a driver.SOLUTION: A vehicle control device 1 includes: a detection unit that detects a motion of a driver of a vehicle, a behavior of the vehicle, and biological information of the driver; an abnormal sign determination unit 38 that determines whether there is an abnormal sign on the driver based on the motion of the driver, the behavior of the vehicle, and the biological information of the driver; and a vehicle controller 41 that performs different types of vehicle control according to a situation of the abnormal sign on the driver.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a vehicle control device, a vehicle control method, and a vehicle control program. [Background technology]

[0002] Conventionally, as a vehicle control device, a vehicle control method, and a vehicle control program, for example, a device that performs vehicle control such as driving assistance when an abnormality in a driver of a vehicle is detected is known, as described in Patent Document 1. This device performs vehicle control according to the driving scene of the vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 2021-14232 Summary of the Invention [Problem to be solved by the invention]

[0004] The above-mentioned device has room for improvement in that it is difficult to ensure the safety of vehicle driving when the driver is abnormal. For this reason, it is desirable to perform vehicle control such as driving assistance early when a sign of abnormality is detected in the driver.

[0005] SUMMARY OF THE PRESENT DISCLOSURE An object of the present invention is to provide a vehicle control device, a vehicle control method, and a vehicle control program that can ensure the safety of vehicle driving even when a driver has an abnormality. [Means for solving the problem]

[0006] In other words, the vehicle control device of the present invention is configured to include a detection unit that detects the movements of the vehicle driver, the behavior of the vehicle, and the driver's biometric information, an abnormality sign determination unit that determines whether the driver has any abnormal signs based on the driver's movements, the behavior of the vehicle, and the driver's biometric information, and a vehicle control unit that performs different vehicle control depending on the status of the driver's abnormal signs. Effect of the Invention

[0007] According to the vehicle control device, the vehicle control method, and the vehicle control program of the present invention, it is possible to ensure the safety of vehicle driving even when the driver has an abnormality. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing an outline of the electrical configuration of a vehicle control device according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing the relationship between the driver's abnormality sign state and abnormality sign detection. [Diagram 3] FIG. 3 is a diagram showing the relationship between driving assistance control and operation restriction in the vehicle control device according to the embodiment. [Figure 4] FIG. 4 is a flowchart showing the operation of the vehicle control device, the vehicle control method, and the vehicle control program according to the embodiment. [Diagram 5] FIG. 5 is a flowchart showing the operation of the vehicle control device, the vehicle control method, and the vehicle control program for stopping control processing according to the embodiment. [Figure 6] FIG. 6 is a flowchart showing the deceleration control process in the operation of the vehicle control device, the vehicle control method, and the vehicle control program according to the embodiment. [Figure 7] FIG. 7 is a flowchart showing the first abnormality sign response control process in the operation of the vehicle control device, the vehicle control method, and the vehicle control program according to the embodiment. [Figure 8] FIG. 8 is a flowchart showing the second abnormality sign response control process in the operation of the vehicle control device, the vehicle control method, and the vehicle control program according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited to this embodiment. In addition, the components in the following embodiments include those that are replaceable and easy for a person skilled in the art, or those that are substantially the same.

[0010] [Embodiment] The present embodiment relates to a vehicle control device, a vehicle control method, and a vehicle control program. As shown in Fig. 1, the vehicle control device 1 is a device that detects abnormal signs and abnormal states of a driver of a vehicle, and performs vehicle control corresponding thereto. Here, the abnormal state is a state in which the driver cannot drive normally, for example, a state in which the driver is unable to drive. The abnormal sign is a state that is different from the normal state of the driver before the abnormal state occurs.

[0011] The vehicle control device 1 is configured to include an input unit 2, a control unit 3, and an output unit 5. The input unit 2 inputs information or data relating to driver's abnormality sign detection, abnormality detection, vehicle control, etc. to the control unit 3. The input unit 2 includes, for example, a camera 21, a biometric information acquisition unit 22, a microphone 23, a switch 24, a vehicle behavior information acquisition unit 25, a driving environment acquisition unit 26, and a vehicle position acquisition unit 27.

[0012] The camera 21 is an imaging unit that images the driver, and is installed in the vehicle to input the image of the driver to the control unit 3. The camera 21 functions as a motion acquisition unit that acquires motion information of the driver. The camera 21 is installed, for example, in the vehicle so as to be able to image the driver from the front. The camera 21 may also include an imaging unit that images the upper body of the driver and an imaging unit that images the face of the driver separately.

[0013] The bioinformation acquisition unit 22 acquires bioinformation of the driver, and examples of such information include a heart rate meter that measures heart rate and pulse rate, a blood pressure monitor that measures blood pressure, and a thermometer that measures body temperature. The heart rate meter, blood pressure monitor, and thermometer may be, for example, a wearable device that can be worn by the driver to perform measurements. In addition, a millimeter wave radar may be used as the heart rate meter. When a millimeter wave radar is used as the heart rate meter, it is possible to measure the heart rate of the driver without contacting the driver, and it is also possible to measure the respiratory rate. The bioinformation acquisition unit 22 is capable of communicating with the control unit 3 via wired or wireless communication, and inputs the bioinformation of the driver to the control unit 3.

[0014] The microphone 23 detects the driver's voice, generates and acquires voice information, and inputs the voice information to the control unit 3. The microphone 23 also acquires voice information or response information of the driver's response to a call from the vehicle control device 1. The switch 24 has, for example, a push button, and acquires the driver's response information to the call from the vehicle control device 1. The switch 24 inputs the response information to the control unit 3. Note that the input unit 2 may include devices or sensors other than the above-mentioned camera 21, biometric information acquisition unit 22, microphone 23, switch 24, and vehicle behavior information acquisition unit 25, as long as the input unit 2 is capable of acquiring information that detects an abnormal state or a sign of an abnormality of the driver.

[0015] The vehicle behavior information acquisition unit 25 is a device that acquires vehicle behavior information, and examples of such devices include a vehicle speed sensor, a steering angle sensor, a camera, and a millimeter wave radar. The vehicle speed sensor detects the vehicle's traveling speed. The steering angle sensor detects the steering angle of the vehicle and provides information on the vehicle's swaying. The camera, for example, captures an image of the area in front of the vehicle and provides information on whether the vehicle has departed from its lane, information on whether the vehicle has exceeded a stop line, and information on the distance between the vehicle and the preceding vehicle. The millimeter wave radar detects the distance between the vehicle and a preceding vehicle or an obstacle in front of the vehicle. The vehicle behavior information acquisition unit 25 may include all or part of the vehicle speed sensor, steering angle sensor, camera, and millimeter wave radar, or may include devices or sensors other than the above-mentioned vehicle speed sensor, steering angle sensor, camera, and millimeter wave radar as long as they can acquire information for detecting abnormal vehicle behavior.

[0016] The driving environment acquisition unit 26 is a device that acquires driving environment information of the vehicle, such as the weather at the device location of the vehicle, the condition of the road on which the vehicle is traveling, whether there is a parking space on the road, etc. Examples of the driving environment acquisition unit 26 include a rainfall sensor and a camera that captures images outside the vehicle. The driving environment acquisition unit 26 may also acquire weather information through communication with the outside of the vehicle and information on parking spaces on the road.

[0017] The vehicle position acquisition unit 27 is a device that acquires information about the vehicle's traveling position, and is, for example, a navigation system.

[0018] The output unit 5 is a device that operates based on a signal output from the control unit 3, and includes, for example, a vehicle control unit 51, a speaker 52, and a monitor 53. The vehicle control unit 51 has control devices that receive control signals output from the control unit 3 and perform braking control, drive control, and steering control of the vehicle. For example, the vehicle control unit 51 is composed of individual control devices that perform braking control, drive control, and steering control of the vehicle. The speaker 52 issues a voice call to the driver based on a signal output from the control unit 3. This speaker 52 functions as a notification unit that notifies the driver through hearing, and for example, operates in response to a voice signal from the control unit 3 and outputs a voice. The monitor 53 functions as a notification unit that notifies the driver through vision, and for example, a liquid crystal display or the like is used, and operates in response to a display signal from the control unit 3. In addition, the monitor 53 may not only function as a display device but also be used as an input device by using a touch panel or the like.

[0019] The control unit 3 is a control unit that controls the vehicle of the driver, and is configured, for example, by a computer. The control unit 3 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., and controls the vehicle by, for example, loading a vehicle control program stored in the ROM into the RAM and executing it with the CPU.

[0020] The control unit 3 includes a motion detection unit 31, a posture detection unit 32, a behavior detection unit 33, a biological information detection unit 34, a voice detection unit 35, a driving support determination unit 36, an abnormality sign control unit 37, an abnormality sign determination unit 38, an abnormality determination unit 39, a vehicle control unit 41, a communication unit 40, and a storage unit 42. The motion detection unit 31, the posture detection unit 32, the behavior detection unit 33, the biological information detection unit 34, the voice detection unit 35, the driving support determination unit 36, the abnormality sign control unit 37, the abnormality sign determination unit 38, the abnormality determination unit 39, and the vehicle control unit 41 are configured, for example, by introducing a vehicle control program into the control unit 3. In addition, the motion detection unit 31, the posture detection unit 32, the behavior detection unit 33, the biological information detection unit 34, the voice detection unit 35, the driving support determination unit 36, the abnormality sign control unit 37, the abnormality sign determination unit 38, the abnormality determination unit 39, and the vehicle control unit 41 may be configured as individual control units.

[0021] The motion detection unit 31 detects the motion of the driver, and detects the motion of the driver using an image analysis method or an image recognition method based on the image information output from the camera 21. As the image analysis method and image recognition method, a publicly known image analysis method and image recognition method may be used. The motion detection unit 31 detects the driver's posture, motion, facial expression, etc. For example, the motion detection unit 31 detects the motion of the driver in an abnormal state and the motion that is a sign of an abnormality in the driver. In addition, the motion detection unit 31 detects the motion related to the driver's illness.

[0022] An example of the driver's abnormality prediction behavior is a pain prediction behavior when the driver feels pain in the body. The pain prediction behavior includes the driver's pain prediction behavior and facial expression, such as a motion of holding the chest, a motion of holding the head, a motion of holding the back, a motion of holding the shoulders, a motion of holding the neck, and a painful facial expression. The driver's pain prediction behavior is a motion of an abnormality prediction behavior before the driver becomes unable to drive. By the motion detection unit 31 detecting the pain prediction behavior, it becomes possible to detect early on that the driver is in an abnormal state in the vehicle control device 1. In addition, by including the motion of holding the chest, the motion of holding the head, and the motion of holding the back as the pain prediction behavior, the motion detection unit 31 can detect abnormal predictions of heart disease, brain disease, and arterial disease (aortic aneurysm, aortic dissection). It is said that more than 70% of accidents caused by driver diseases are caused by heart disease, brain disease, and arterial disease. Therefore, by detecting abnormal predictions of heart disease, brain disease, and arterial disease, it becomes possible to accurately improve the safety of vehicle driving.

[0023] The posture detection unit 32 detects the posture of the driver, and detects the posture of the driver using an image analysis method or an image recognition method based on the image information output from the camera 21. The posture detection unit 32 detects postures that are precursors of abnormality and abnormal states of the driver. An abnormal state of the driver's posture corresponds, for example, to a driver's poor posture. A poor posture is a state in which the driver's posture has deteriorated from the normal driving posture, and corresponds, for example, to a state in which the driver is leaning against the seat and not firmly gripping the steering wheel, or a state in which the driver is crouching.

[0024] The behavior detection unit 33 detects the behavior of the vehicle, and detects abnormal behavior of the vehicle based on the behavior information acquired by the vehicle behavior information acquisition unit 25. For example, the behavior detection unit 33 detects abnormal behavior of the vehicle caused by a driver's abnormal sign. Specifically, the behavior detection unit 33 detects abnormal behavior of the vehicle such as departure from the vehicle's lane, swaying driving of the vehicle, delayed operation of the vehicle, crossing a stop line, driving with a risk of a forward collision, etc. Therefore, the behavior detection unit 33 functions as a vehicle behavior detection unit.

[0025] The biological information detection unit 34 detects the biological information of the driver, and detects biological information that is a sign of an abnormality in the driver, based on the biological information of the driver acquired by the biological information acquisition unit 22. For example, the biological information detection unit 34 detects all or some of the following: an increase in pulse rate above a predetermined value, a decrease in pulse rate below a predetermined value, an increase in blood pressure above a predetermined value, a decrease in blood pressure below a predetermined value, pulse wave abnormalities, arrhythmia, an increase in respiratory rate above a predetermined value, and a decrease in respiratory rate below a predetermined value.

[0026] The voice detection unit 35 detects the voice of the driver, and detects voice information that is a sign of an abnormality in the driver based on the voice information acquired by the microphone 23. For example, the voice detection unit 35 detects voice related to the driver's illness, and detects voice that is a sign of an abnormality in the driver. For example, the voice detection unit 35 detects the driver's moans and screams as voices that are a sign of an abnormality in the driver. In this case, the voice detection unit 35 functions as a movement detection unit that detects the movement of the driver.

[0027] The driving assistance determination unit 36 ​​determines whether or not the execution of driving assistance control is restricted based on the driving environment of the vehicle. For example, when multiple driving assistance controls are possible as driving assistance controls for the vehicle, some controls may not be executable depending on the driving environment. The driving assistance determination unit 36 ​​determines whether or not the execution of driving assistance control is restricted based on the driving environment information acquired by the driving environment acquisition unit 26, and determines which driving assistance control is restricted.

[0028] For example, as shown in FIG. 3, when the driving environment is good (normal), maximum speed suppression control, pedal erroneous operation suppression control, forward collision warning control, collision mitigation brake control, collision avoidance control, lane departure warning control, lane departure suppression control, evacuation stop control, and following drive control can be executed as driving assistance controls of the vehicle, but some controls may not be executed depending on the driving environment. For example, when the road on which the vehicle is traveling is under construction or in bad weather, lane detection cannot be performed, and the execution of collision avoidance control, lane departure warning control, lane departure suppression control, and evacuation stop control may be restricted. In addition, when the vehicle is not traveling on a motorway, the execution of following drive control may be restricted. In this way, the driving assistance determination unit 36 ​​determines which driving assistance control is to be restricted based on the driving environment of the vehicle. Even if the driving assistance control is restricted when the driver is in an abnormality prediction state or an abnormal state, the vehicle control device 1 ensures the safety of vehicle driving by other driving assistance control or vehicle control.

[0029] The abnormality sign control unit 37 performs abnormality sign response control when the driver has an abnormality sign. For example, the abnormality sign control unit 37 performs a process of calling the driver as to whether or not the driver is able to drive, and determines whether or not there is a response from the driver. In this case, the abnormality sign control unit 37 outputs a control signal to the speaker 52 or the monitor 53 to notify the driver by voice output or image display, and inputs a response signal from the driver through the microphone 23 or the switch 24. In addition, when the driving assistance control is restricted, the abnormality sign control unit 37 notifies the driver of this fact. In this case, the abnormality sign control unit 37 outputs a control signal to the speaker 52 or the monitor 53 to notify the driver by voice output or image display.

[0030] The abnormality sign determination unit 38 determines whether or not there is an abnormality sign of the driver. For example, the abnormality sign determination unit 38 determines whether or not there is an abnormality sign of the driver based on the detection results of the action detection unit 31, the behavior detection unit 33, and the biological information detection unit 34.

[0031] For example, as shown in Fig. 2, the abnormality sign determination unit 38 determines that the driver is in an abnormality sign state when the motion detection unit 31, the behavior detection unit 33, and part of the biological information detection unit 34 detect that the driver has an abnormality sign. That is, when at least one of the motion of the driver that is a sign of an abnormality detected by the motion detection unit 31, the abnormal behavior of the vehicle that is a sign of an abnormality detected by the behavior detection unit 33, and the biological information that is a sign of an abnormality detected by the biological information detection unit 34 is detected, the abnormality sign determination unit 38 determines that the driver is in an abnormality sign state. On the other hand, when none of the motion of the driver that is a sign of an abnormality detected by the motion detection unit 31, the abnormal behavior of the vehicle that is a sign of an abnormality detected by the behavior detection unit 33, and the biological information that is a sign of an abnormality detected by the biological information detection unit 34 is detected, the abnormality sign determination unit 38 determines that the driver is not in an abnormality sign state. Furthermore, when all of the driver's behavior as a sign of an abnormality detected by the behavior detection unit 31, the abnormal vehicle behavior detected by the behavior detection unit 33, and the biological information as a sign of an abnormality detected by the biological information detection unit 34 are detected, the abnormality sign determination unit 38 determines that the driver is not in an abnormality sign state. In this case, the abnormality determination unit 39 determines that the driver is in an abnormal state.

[0032] The abnormality determination unit 39 determines whether the driver is in an abnormal state. For example, when the movement detection unit 31 detects that the driver has closed eyes, fainted, or white eyes, the abnormality determination unit 39 determines that the driver is in an abnormal state because he / she is unable to drive. Also, when the posture detection unit 32 detects that the driver has a poor posture, the abnormality determination unit 39 determines that the driver is in an abnormal state. Also, even if the driver is not in a closed eyes, fainted, white eyes, or poor posture state, the abnormality determination unit 39 may determine that the driver is in an abnormal state if the driver is unable to drive.

[0033] Furthermore, the abnormality determination unit 39 determines that the driver is in an abnormal state when all of the driver's behavior as a sign of an abnormality detected by the behavior detection unit 31, the abnormal vehicle behavior detected by the behavior detection unit 33, and the biological information as a sign of an abnormality detected by the biological information detection unit 34 are detected. Furthermore, the abnormality determination unit 39 determines that the driver is in an abnormal state when the abnormality sign determination unit 38 determines that there is an abnormal sign and the driver does not respond to a call to the driver through the speaker 52 or the monitor 53 as to whether or not he or she is able to drive.

[0034] The communication unit 40 is a part that performs wireless communication with the outside of the control unit 3. For example, the communication unit 40 performs wireless communication with the biometric information acquisition unit 22 and acquires the biometric information of the driver.

[0035] When the abnormality judgment unit 39 judges that the driver is in an abnormal state, or when the abnormality prediction judgment unit 38 judges that the driver is in an abnormality prediction state, the vehicle control unit 41 outputs a control signal to the vehicle control unit 51 and executes driving assistance control and vehicle control to ensure safe vehicle driving.

[0036] The storage unit 42 stores information or data related to vehicle control, etc. For example, the storage unit 42 stores a vehicle control program, control data, etc.

[0037] Next, the operation of the vehicle control device 1, the vehicle control method, and the vehicle control program according to the present embodiment will be described.

[0038] Fig. 4 is a flowchart showing the operation, vehicle control method, and vehicle control program of the vehicle control device 1. A series of control processes in the flowchart of Fig. 4 is started, for example, when the ignition or power switch of the vehicle is turned on, and is repeatedly executed by the control unit 3 at a predetermined cycle.

[0039] First, as shown in step S10 (hereinafter simply referred to as "S10"; the same applies to steps after S10) in Fig. 4, a step of reading information related to vehicle control is performed. Information related to vehicle control is, for example, information output from the camera 21, biometric information acquisition unit 22, microphone 23, switch 24, vehicle behavior information acquisition unit 25, driving environment acquisition unit 26, and vehicle position acquisition unit 27, which is input to the control unit 3 and read.

[0040] Then, the process proceeds to S12, where a driver's motion detection process is performed. The motion detection process is a process of detecting the driver's motion, and is performed by the motion detection unit 31 using, for example, an image analysis method or an image recognition method based on image information output from the camera 21. The motion detection unit 31 detects the driver's motion of an abnormal state, such as letting go of the steering wheel, fainting, closing the eyes, or rolling the eyes. The motion detection unit 31 also detects the pain motion when the driver feels pain in the body, as a motion that is a sign of the driver's abnormality. Specifically, the motion detection unit 31 detects the pain motion, such as pressing the chest, pressing the head, pressing the back, pressing the shoulders, pressing the neck, and a painful facial expression. In the motion detection process, by detecting the driver's pain motion, it is possible to detect the abnormality due to the disease. Therefore, the vehicle control device 1, the vehicle control method, and the vehicle control program make it possible to accurately and early detect the driver's abnormality.

[0041] The movement detection step may be performed by the voice detection unit 35 using a voice analysis method or the like based on the voice information output from the microphone 23. The voice detection unit 35 detects voice related to the driver's illness and detects voice that is a sign of an abnormality in the driver. For example, the voice detection unit 35 detects the driver's moans and screams as voices that are a sign of an abnormality in the driver.

[0042] Then, the process proceeds to S14, where a driver's posture detection process is performed. The posture detection process is a process for detecting the posture of the driver, and is performed by the posture detection unit 32 using, for example, an image analysis method or an image recognition method based on the image information output from the camera 21. The posture detection unit 32 detects a posture collapse state as an abnormal state of the driver's movement.

[0043] Then, the process proceeds to S16, where a vehicle behavior detection process is performed. The vehicle behavior detection process is a process for detecting the behavior of the vehicle, and is performed by the behavior detection unit 33 based on the behavior information acquired by the vehicle behavior information acquisition unit 25. For example, the behavior detection unit 33 detects abnormal vehicle behavior caused by a driver's abnormal sign. Specifically, the behavior detection unit 33 detects lane departure of the vehicle, swaying of the vehicle, delayed operation of the vehicle, crossing a stop line, driving with a risk of a forward collision, and the like, as abnormal vehicle behavior.

[0044] Then, the process proceeds to S18, where a biological information detection process is performed. The biological information detection process is a process of detecting the biological information of the driver, and is performed by the biological information detection unit 34. The biological information detection unit 34 detects biological information that is a sign of an abnormality in the driver. For example, the biological information detection unit 34 detects all or some of the following: an increase in pulse rate above a predetermined value, a decrease in pulse rate below a predetermined value, an increase in blood pressure above a predetermined value, a decrease in blood pressure below a predetermined value, pulse wave abnormalities, arrhythmia, an increase in respiratory rate above a predetermined number, and a decrease in respiratory rate below a predetermined number.

[0045] Then, the process proceeds to S20, where it is determined whether the driver is in an abnormal state. This process is performed, for example, by the abnormality determination unit 39. The abnormality determination unit 39 determines whether the driver is in an abnormal state based on the detection results of the action detection unit 31, the posture detection unit 32, the behavior detection unit 33, and the biological information detection unit 34. For example, when an abnormal state such as the driver's posture being disturbed is detected by the posture detection unit 32 and the abnormal state is continuously detected for a preset time T1, the abnormality determination unit 39 determines that the driver is in an abnormal state. For example, the time T1 is set to a time between 5 and 10 seconds. In this way, the vehicle control device 1 determines that the driver is in an abnormal state when the driver is continuously in an abnormal state for the time T1, thereby suppressing erroneous determination of the abnormal state.

[0046] Furthermore, when the motion detection unit 31, the behavior detection unit 33, and the biological information detection unit 34 all detect that the driver is in an abnormality premonition state, and the abnormality premonition state is continuously detected for a preset time T2, the abnormality determination unit 39 determines that the driver is in an abnormal state. For example, the time T2 is set longer than the time T1, and is set to a time between 10 and 60 seconds. In this way, the vehicle control device 1 determines that the driver is in an abnormal state when the abnormality premonition state continues for the time T2, thereby suppressing erroneous determination of an abnormal state.

[0047] On the other hand, if the posture detection unit 32 does not detect an abnormal state for a continuous period of time T1, and if the movement detection unit 31, the behavior detection unit 33, and the biometric information detection unit 34 all do not detect an abnormality precursor state for a continuous period of time T2, the abnormality determination unit 39 determines that the driver is not in an abnormal state.

[0048] If it is determined in S20 that the driver is in an abnormal state, it is determined whether or not there is a restriction on the execution of the driving assistance control (S22). This determination step is executed by the driving assistance determination unit 36. For example, the driving assistance determination unit 36 ​​determines whether or not the execution of the driving assistance control is restricted based on the driving environment information acquired by the driving environment acquisition unit 26, and determines which driving assistance control is restricted from the execution. Specifically, the driving assistance determination unit 36 ​​determines whether or not the execution of the collision avoidance control, lane departure warning control, lane departure suppression control, evacuation stop control, and following drive control is restricted from the maximum speed suppression control, pedal erroneous operation suppression control, forward collision warning control, collision mitigation brake control, collision avoidance control, lane departure warning control, lane departure suppression control, evacuation stop control, and following drive control.

[0049] If it is determined in S22 that the execution of the driving assistance control is not restricted, a stop control process is executed (S28). Details of the stop control process will be described later. On the other hand, if it is determined in S22 that the execution of the driving assistance control is restricted, a deceleration control process is executed (S30). Details of the deceleration control process will be described later. When the stop control process of S28 and the deceleration control process of S30 are completed, the series of control processes in FIG. 4 are terminated.

[0050] Meanwhile, when it is determined in S20 that the driver is not in an abnormal state, it is determined whether or not the driver is in an abnormal sign state (S24). This step is performed, for example, by the abnormal sign determination unit 38. The abnormal sign determination unit 38 determines whether or not the driver is in an abnormal sign state based on the detection results of the action detection unit 31, the behavior detection unit 33, and the biological information detection unit 34. For example, when the action detection unit 31, the behavior detection unit 33, and a part of the biological information detection unit 34 detect that the driver is in an abnormal sign state, and the abnormal sign state is continuously detected for a preset time T3, the abnormal sign determination unit 38 determines that the driver is in an abnormal sign state. For example, the time T3 is set shorter than the time T2, and is set to a time between 10 and 30 seconds. In this way, the vehicle control device 1 determines that the driver is in an abnormal sign state when the driver is continuously in an abnormal sign state for the time T3, thereby suppressing erroneous determination of the abnormal sign state.

[0051] On the other hand, if an abnormality premonition state is not detected by the movement detection unit 31, the behavior detection unit 33, and part of the biometric information detection unit 34 for a continuous period of time T3, the abnormality premonition determination unit 38 determines that the driver is not in an abnormality premonition state.

[0052] If it is determined in S24 that the driver is not in an abnormality prediction state, the series of control processes in FIG. 4 is terminated. On the other hand, if it is determined in S24 that the driver is in an abnormality prediction state, it is determined whether or not there is a restriction on the execution of the driving assistance control (S26). This determination step is executed by the driving assistance determination unit 36. For example, the driving assistance determination unit 36 ​​determines whether or not the execution of the driving assistance control is restricted based on the driving environment information acquired by the driving environment acquisition unit 26, and determines which driving assistance control is restricted from the execution. Specifically, the driving assistance determination unit 36 ​​determines whether or not the execution of the collision avoidance control, lane departure warning control, lane departure suppression control, evacuation stop control, and following drive control is restricted from the maximum speed suppression control, pedal erroneous operation suppression control, forward collision warning control, collision mitigation brake control, collision avoidance control, lane departure warning control, lane departure suppression control, evacuation stop control, and following drive control.

[0053] If it is determined in S26 that the execution of the driving assist control is not restricted, a first abnormality sign response control process is executed (S32). Details of the first abnormality sign response control process will be described later. On the other hand, if it is determined in S26 that the execution of the driving assist control is restricted, a second abnormality sign response control process is executed (S34). Details of the second abnormality sign response control process will be described later. When the first abnormality sign response control process of S32 and the second abnormality sign response control process of S34 have ended, the series of control processes in FIG. 4 end.

[0054] Fig. 5 is a flowchart of the vehicle stop control process shown in S28 of Fig. 4. The control process of the flowchart of Fig. 5 is executed by the control unit 3, for example.

[0055] First, as shown in S40 of FIG. 5, a deceleration control process is performed. The deceleration control process is a process of decelerating the vehicle by automatic control, and is executed, for example, by slowly decelerating the vehicle until the target speed is reached at a deceleration of about the deceleration of the engine brake. Then, the process proceeds to S42, and the driving assistance control is started. For example, all the operable driving assistance controls are started. Specifically, when the maximum speed suppression control, the pedal erroneous operation suppression control, the forward collision warning control, the collision mitigation brake control, the collision avoidance control, the lane departure warning control, the lane departure suppression control, the evacuation stop control, and the following driving control are possible as the driving assistance control of the vehicle, all of these controls are started, and the braking control, the steering control, and the like are executed according to the vehicle driving situation. Note that, when the vehicle is not traveling on a motor vehicle-only road, the following driving control is not started.

[0056] Then, the process proceeds to S44, where it is determined whether or not there is a cancellation signal for the stop control process. If it is determined in S44 that there is a cancellation signal for the stop control process, the process proceeds to S46, where it is determined whether or not cancellation of the stop control process is at the driver's request. If it is determined in S46 that cancellation of the stop control process is at the driver's request, the stop control process of FIG. 5 is terminated. On the other hand, if it is determined in S46 that cancellation of the stop control process is not at the driver's request, the process proceeds to the deceleration control process of FIG. 6.

[0057] Incidentally, if it is determined in S44 that there is no cancellation signal for the stopping control process, the process proceeds to S48, where it is determined whether or not the target speed has been reached. That is, it is determined whether or not the vehicle speed has reached the target speed through the deceleration control in S40. If it is determined in S48 that the target speed has not been reached, the process returns to S44. On the other hand, if it is determined in S48 that the target speed has been reached, the process proceeds to S50, where the stopping control process is performed.

[0058] The vehicle stop control step of S50 is a control for stopping the vehicle. For example, in the vehicle stop control step, first, it is determined whether or not there is a stopping space on the road on which the vehicle is traveling. If it is determined that there is a stopping space, the vehicle is decelerated toward the stopping space, and steering control is also performed as necessary. At this time, the hazard lamps and brake lamps of the vehicle are turned on, and a notice of an abnormal state is given after the vehicle has stopped, and treatment of the disease may be performed as necessary.

[0059] On the other hand, if it is determined in the stopping control process of S50 that there is no stopping space, the vehicle is driven to a location where a stopping space can be detected. At this time, the vehicle's traveling speed is set to a speed that matches the traffic flow. Also, if the vehicle is traveling on a road where stopping is not possible, such as a highway, the vehicle is driven to a location where it can be stopped while observing the speed limit, and the vehicle is stopped at the location. Then, when the stopping control process of S50 is completed, the series of control processes in FIG. 5 is terminated.

[0060] Fig. 6 is a flowchart of the deceleration control process shown in S30 of Fig. 4. The control process of the flowchart of Fig. 6 is executed by the control unit 3, for example.

[0061] First, driving assistance control is started as shown in S60 of Fig. 6. For example, in the driving assistance control of the vehicle, among maximum speed suppression control, pedal erroneous operation suppression control, forward collision warning control, collision mitigation brake control, collision avoidance control, lane departure warning control, lane departure suppression control, evacuation stop control, and following driving control, maximum speed suppression control, pedal erroneous operation suppression control, forward collision warning control, and collision mitigation brake control are started.

[0062] Then, as shown in S62, a first deceleration control step is performed. The first deceleration control step is a step in which the vehicle is decelerated by automatic control to set the vehicle speed to a first target speed. For example, in the first deceleration control step, the vehicle is decelerated slowly until it reaches the first target speed at a deceleration equivalent to the deceleration of engine braking.

[0063] Then, the process proceeds to S64, where it is determined whether or not there is a control process release signal. If it is determined in S64 that there is a control process release signal, the deceleration control process of FIG. 6 is terminated. On the other hand, if it is determined in S64 that the control process has not been released, the process proceeds to S66, where it is determined whether or not the vehicle stop control process is possible. Here, if it is determined in S66 that the vehicle stop control process is possible, the process proceeds to the vehicle stop control process of FIG. 5.

[0064] On the other hand, if it is determined in S66 that the vehicle stop control process is not possible, the process proceeds to S68, where it is determined whether the vehicle speed has reached the first target speed. If it is determined in S68 that the vehicle speed has not reached the first target speed, the process returns to the first deceleration control process of S62.

[0065] On the other hand, if it is determined in S68 that the vehicle speed has reached the first target speed, the process proceeds to S70, where a second deceleration control process is performed. The second deceleration control process is a process in which the vehicle is decelerated by automatic control to set the vehicle speed to a second target speed. The second target speed is set to a speed slower than the first target speed. In the second deceleration control process, the vehicle is slowly decelerated until it reaches the second target speed. In this second deceleration control process, an outside vehicle notification may be performed, and the hazard lights may be turned on and the horn may be activated.

[0066] Then, the process proceeds to S72, where it is determined whether or not there is a control process release signal. If it is determined in S72 that there is a control process release signal, the deceleration control process of FIG. 6 is terminated. On the other hand, if it is determined in S72 that there is no control process release, the process proceeds to S74, where it is determined whether or not the vehicle stop control process is possible. Here, if it is determined in S74 that the vehicle stop control process is possible, the process proceeds to the vehicle stop control process of FIG. 5.

[0067] On the other hand, if it is determined in S74 that the vehicle stop control process is not possible, the process proceeds to S76, where it is determined whether the vehicle speed has reached the second target speed. If it is determined in S76 that the vehicle speed has not reached the second target speed, the process returns to the second deceleration control process of S70.

[0068] On the other hand, if it is determined in S76 that the vehicle speed has reached the second target speed, the process proceeds to S78, where a driving control process is performed. The driving control process is a control process for allowing the vehicle to continue to run by automatic control. In this case, the vehicle continues to run except when the driving assistance control in S60 is executed to stop the vehicle. In addition, in the driving control process in S76, if monitoring control of the vehicle is possible, vehicle control procedures may be performed by remote control. After the driving control process in S76 is completed, the deceleration control process in FIG. 6 is terminated.

[0069] Fig. 7 is a flowchart of the first abnormality sign response control process shown in S32 of Fig. 4. The control process of the flowchart of Fig. 7 is executed by the control unit 3, for example.

[0070] First, as shown in S90 of Fig. 7, driving assistance control is started. For example, among the maximum speed suppression control, pedal erroneous operation suppression control, forward collision warning control, collision mitigation brake control, collision avoidance control, lane departure warning control, lane departure suppression control, evacuation stop control, and following driving control in the driving assistance control of the vehicle, the maximum speed suppression control, pedal erroneous operation suppression control, forward collision warning control, collision mitigation brake control, collision avoidance control, lane departure warning control, lane departure suppression control, evacuation stop control, and following driving control are started. By starting such driving assistance control, the vehicle control device 1 can improve the safety of vehicle driving when the driver is in an abnormality prediction state.

[0071] Then, as shown in S92, it is determined whether a preset time T4 has elapsed since the abnormality prediction state was detected. The time T4 is set to be longer than the time T2, for example, about 1.5 minutes. If it is determined in S92 that the time T4 has not elapsed, the first abnormality prediction response control process in FIG. 7 is terminated. On the other hand, if it is determined in S92 that the time T4 has elapsed, the process proceeds to S94, the threshold value for executing the driving assistance control is changed, and the driving assistance control becomes easier to execute. As a result, the longer the abnormality prediction state of the driver continues, the easier it becomes for the driving assistance control to be executed, and the safety of vehicle driving is improved.

[0072] Then, the process proceeds to S96, where a calling process is performed. The calling process is a process for calling the driver as to whether or not the driver is able to drive the vehicle. For example, the calling may be made by voice through the speaker 52, or by image display on the monitor 53.

[0073] Then, the process proceeds to S98, where it is determined whether or not there is a response to the call. For example, it is determined whether or not there is a response to the call within a preset time T5. Time T5 is set, for example, to about 10 seconds. If there is a response in S98, it is determined that the driver is capable of driving the vehicle, and the first abnormality sign response control process in FIG. 7 is terminated. On the other hand, if there is no response in S98, it is determined that the driver is incapable of driving, and the process proceeds to the stop control process in FIG. 5. Once S98 is completed, the first abnormality sign response control process in FIG. 7 is terminated.

[0074] Fig. 8 is a flowchart of the second abnormality sign response control process shown in S34 of Fig. 4. The control process of the flowchart of Fig. 8 is executed by the control unit 3, for example.

[0075] First, as shown in S110 of Fig. 8, driving assistance control is started. For example, in the driving assistance control of the vehicle, among maximum speed suppression control, pedal erroneous operation suppression control, forward collision warning control, collision mitigation brake control, collision avoidance control, lane departure warning control, lane departure suppression control, evacuation stop control, and following driving control, maximum speed suppression control, pedal erroneous operation suppression control, forward collision warning control, and collision mitigation brake control are started. By starting such driving assistance control, the vehicle control device 1 can increase the safety of vehicle driving when the driver is in an abnormality prediction state.

[0076] Then, as shown in S112, it is determined whether a preset time T6 has elapsed since the abnormality precursor state was detected. Time T6 is set to be approximately the same as time T2, and is set to be between 10 and 60 seconds, for example. If it is determined in S112 that time T6 has not elapsed, the second abnormality precursor response control process in Fig. 8 is terminated. On the other hand, if it is determined in S112 that time T6 has elapsed, the process proceeds to S114, where a deceleration control process is performed. This deceleration control step is a step of decelerating the vehicle by automatic control, and is executed, for example, by gradually decelerating the vehicle until the target speed is reached at a deceleration approximately equal to the deceleration of engine braking.

[0077] Then, the process proceeds to S116, where a notification process is performed. In the notification process, the driver is notified that there is a sign of an abnormality, and that support by automatic control cannot be performed due to limitations on the driving support control. This notification is performed, for example, by audio output from the speaker 52 or display output from the monitor 53. Then, the process proceeds to S118, where a calling process is performed. The calling process is a process for calling the driver as to whether or not the driver is able to drive the vehicle. For example, the calling may be made by voice through the speaker 52, or by image display on the monitor 53.

[0078] Then, the process proceeds to S120, where it is determined whether or not there is a response to the call in S118. For example, it is determined whether or not there is a response to the call within a preset time T5. If there is a response in S120, it is determined that the driver is capable of driving the vehicle, and the second abnormality sign response control process in FIG. 8 is terminated. On the other hand, if there is no response in S120, the process proceeds to the deceleration control process in FIG. 6. Once the process in S120 is completed, the second abnormality sign response control process in FIG. 8 is terminated.

[0079] As described above, the vehicle control device 1, vehicle control method, and vehicle control program of this embodiment perform different vehicle control depending on the abnormality indication situation of the driver, thereby enabling the driver to perform appropriate vehicle control depending on the abnormality indication situation, thereby ensuring the safety of vehicle driving.

[0080] In addition, the vehicle control device 1, vehicle control method, and vehicle control program of this embodiment can ensure the safety of vehicle driving until the driver enters an abnormal state by activating driving assistance control that improves vehicle driving safety from the time the driver is determined to be exhibiting signs of an abnormality to the time the driver is determined to be in an abnormal state.

[0081] In addition, the vehicle control device 1, vehicle control method, and vehicle control program of this embodiment can ensure the safety of vehicle driving by activating at least one of vehicle speed limit control, driving error suppression control, collision warning control, collision mitigation braking control, collision avoidance control, lane departure warning control, and lane departure suppression control as driving assistance control that improves vehicle driving safety.

[0082] Furthermore, the vehicle control device 1, vehicle control method, and vehicle control program according to the present embodiment change the execution threshold value of the driving assistance control to facilitate the execution of the driving assistance control when a preset time has elapsed since it was determined that the driver is in an abnormal condition. Therefore, the vehicle control device 1, vehicle control method, and vehicle control program according to the present embodiment can improve the safety of vehicle driving when the possibility of the driver being in an abnormal condition increases.

[0083] Furthermore, the vehicle control device 1, the vehicle control method, and the vehicle control program according to the present embodiment can ensure the safety of vehicle travel by at least executing the deceleration control of the vehicle when the execution of the driving assistance control is restricted.

[0084] The vehicle control device, the vehicle control method, and the vehicle control program according to the present invention are not limited to the above-described embodiment, and various modifications are possible within the scope of the claims. The vehicle control device 1, the vehicle control method, and the vehicle control program according to the present embodiment may be configured by appropriately combining the components of the above-described embodiment and modified examples. [Explanation of symbols]

[0085] 1: Vehicle control device 31: Motion detection unit (detection unit) 32: Attitude detection unit (detection unit) 33: Behavior detection unit (detection unit) 34: Biometric information detection unit (detection unit) 36: Driving assistance judgment unit 38: Abnormality prediction determination unit 39: Abnormality determination section 41: Vehicle control unit

Claims

1. A detection unit that detects a motion of a driver of a vehicle, a behavior of the vehicle, and biological information of the driver; an abnormality sign determination unit that determines whether or not the driver has an abnormality sign based on a movement of the driver, a behavior of the vehicle, and biological information of the driver; A vehicle control unit that performs different vehicle control depending on the state of the abnormality sign of the driver. Vehicle control device.

2. the detection unit includes a posture detection unit that detects a posture of the driver that is an abnormal state, a motion detection unit that detects a motion of the driver that is a sign of an abnormality, a vehicle behavior detection unit that detects abnormal behavior of the vehicle associated with the sign of an abnormality of the driver, and a biological information detection unit that detects biological information that is a sign of an abnormality of the driver, An abnormality determination unit that determines whether the driver is in an abnormal state by using at least a detection result of the posture detection unit, The vehicle control unit activates a driving assistance control for enhancing driving safety of the vehicle from the time when it is determined that the driver has an abnormality sign to the time when it is determined that the driver is in an abnormal state. The vehicle control device according to claim 1.

3. The vehicle control unit activates at least one of a speed limit control of the vehicle, a driving error suppression control, a collision warning control, a collision mitigation braking control, a collision avoidance control, a lane departure warning control, and a lane departure suppression control as the driving assistance control for enhancing the driving safety of the vehicle. The vehicle control device according to claim 2.

4. The vehicle control unit changes an execution threshold of the driving assistance control to make it easier to execute the driving assistance control when a preset time has elapsed since it was determined that the driver is experiencing an abnormality. The vehicle control device according to claim 2 or 3.

5. A driving assistance determination unit that determines whether or not execution of the driving assistance control is restricted, When the driving assistance determination unit determines that the execution of the driving assistance control is to be restricted, the vehicle control unit performs a vehicle control different from a vehicle control performed when the driving assistance determination unit determines that the execution of the driving assistance control is not to be restricted, and performs at least a deceleration control of the vehicle. The vehicle control device according to claim 2 or 3.

6. A detection step of detecting a motion of a driver of a vehicle, a behavior of the vehicle, and biological information of the driver; an abnormality sign determination step of determining whether or not the driver has an abnormality sign based on a movement of the driver, a behavior of the vehicle, and biological information of the driver; and a vehicle control step of performing different vehicle controls depending on a state of the driver's abnormality sign.

7. A vehicle control program for causing a computer to execute vehicle control, A detection step of detecting a motion of a driver of a vehicle, a behavior of the vehicle, and biological information of the driver; an abnormality sign determination step of determining whether or not the driver has an abnormality sign based on a movement of the driver, a behavior of the vehicle, and biological information of the driver; a vehicle control step of performing different vehicle control depending on the state of the abnormality sign of the driver; Vehicle control program.

Images