Abnormality detection device, abnormality detection method, and abnormality detection program

Abstract

To provide an abnormality detection device, abnormality detection method, and abnormality detection program capable of accurately detecting an abnormality of a driver in an early stage.SOLUTION: An abnormality detection device 1 includes: an action detection section 31 for detecting a pain action caused by a physical disease of a driver based on action information of the driver acquired by a camera 21; a behavior detection section 32 for detecting an abnormal behavior of a vehicle based on behavior information acquired by a vehicle behavior information acquisition section 25; a biological information detection section 33 for detecting biological information to be an abnormal sign of the driver based on the biological information acquired by a biological information acquisition section 22; and an abnormal sign determination section 35 for determining whether there is a physical abnormal sign of the driver with the use of all or some of a detection result obtained by the action detection section 31, a detection result obtained by the behavior detection section 32, and a detection result obtained by the biological information detection section 33.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an abnormality detection device, an abnormality detection method, and an abnormality detection program. [Background technology]

[0002] Conventionally, as an abnormality detection device, an abnormality detection method, and an abnormality detection program, a device that detects an abnormality or deterioration in the physical condition of a vehicle driver is known, as described in Patent Document 1. This device detects the abnormality or deterioration in the physical condition of the driver by detecting the driver's posture, facial direction, etc. using a camera that captures an image of the driver. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2013 / 8300 Summary of the Invention [Problem to be solved by the invention]

[0004] The above-mentioned device has room for improvement in that it is difficult to accurately detect an abnormality in the driver at an early stage. Although the above-mentioned device detects an abnormality or deterioration in the driver, it is desirable to detect an abnormality in the driver at an early stage from the viewpoint of the safety of vehicle driving.

[0005] Therefore, an object of the present invention is to provide an abnormality detection device, an abnormality detection method, and an abnormality detection program that can detect an abnormality in a driver accurately and early. [Means for solving the problem]

[0006] In other words, the abnormality detection device of the present invention is configured to include an input unit that inputs the vehicle driver's operation information, biometric information, and behavior information of the vehicle, a detection unit that detects signs of abnormality in the driver based on the operation information, the biometric information, and the behavior information, and an abnormality sign judgment unit that judges whether or not there are signs of abnormality in the driver's body based on the detection results of the detection unit. Effect of the Invention

[0007] According to the abnormality detection device, the abnormality detection method, and the abnormality detection program of the present invention, an abnormality in a driver can be detected early with high accuracy. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing an outline of the electrical configuration of an abnormality detection device according to an embodiment. [Diagram 2] FIG. 2 is a flowchart showing the operation of the abnormality detection device, the abnormality detection method, and the abnormality detection program according to the embodiment. [Diagram 3] FIG. 3 is an explanatory diagram showing an example of an abnormality sign and an abnormal state of the driver. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited to this embodiment. In addition, the components in the following embodiments include those that are replaceable and easy for a person skilled in the art, or those that are substantially the same.

[0010] [Embodiment] The present embodiment relates to an abnormality detection device, an abnormality detection method, and an abnormality detection program. As shown in Fig. 1, the abnormality detection device 1 is a device that detects a sign of an abnormality in a driver of a vehicle and detects an abnormal state of the driver. Here, the abnormal state is a state in which the driver cannot drive normally, for example, a state in which the driver is unable to drive. The sign of an abnormality is a state that is different from the normal state of the driver before the abnormal state occurs.

[0011] The abnormality detection device 1 is configured to include an input unit 2, a control unit 3, and an output unit 4. The input unit 2 inputs information or data relating to abnormality detection of the driver to the control unit 3, for example, inputting operation information, biometric information, and behavior information of the vehicle of the driver. The input unit 2 includes, for example, a camera 21, a biometric information acquisition unit 22, a microphone 23, a switch 24, and a vehicle behavior information acquisition unit 25.

[0012] The camera 21 is an imaging unit that images the driver, and is installed in the vehicle to input the image of the driver to the control unit 3. The camera 21 functions as a motion acquisition unit that acquires motion information of the driver. The camera 21 is installed, for example, in the vehicle so as to be able to image the driver from the front. The camera 21 may also include an imaging unit that images the upper body of the driver and an imaging unit that images the face of the driver separately.

[0013] The bioinformation acquisition unit 22 acquires bioinformation of the driver, and examples of such information include a heart rate meter that measures heart rate and pulse rate, a blood pressure monitor that measures blood pressure, and a thermometer that measures body temperature. The heart rate meter, blood pressure monitor, and thermometer may be, for example, a wearable device that can be worn by the driver to perform measurements. In addition, a millimeter wave radar may be used as the heart rate meter. When a millimeter wave radar is used as the heart rate meter, it is possible to measure the heart rate of the driver without contacting the driver, and it is also possible to measure the respiratory rate. The bioinformation acquisition unit 22 is capable of communicating with the control unit 3 via wired or wireless communication, and inputs the bioinformation of the driver to the control unit 3.

[0014] The microphone 23 detects the driver's voice, generates and acquires voice information, and inputs the voice information to the control unit 3. The microphone 23 also acquires voice information or response information of the driver's response to a call from the abnormality detection device 1. The switch 24 has, for example, a push button, and acquires the driver's response information to the call from the abnormality detection device 1. The switch 24 inputs the response information to the control unit 3. Note that the input unit 2 may include devices or sensors other than the above-mentioned camera 21, biometric information acquisition unit 22, microphone 23, switch 24, and vehicle behavior information acquisition unit 25, as long as the input unit 2 is capable of acquiring information for detecting an abnormal state or a sign of an abnormality of the driver.

[0015] The vehicle behavior information acquisition unit 25 is a device that acquires vehicle behavior information, and examples of such devices include a vehicle speed sensor, a steering angle sensor, a camera, and a millimeter wave radar. The vehicle speed sensor detects the vehicle's traveling speed. The steering angle sensor detects the steering angle of the vehicle and provides information on the vehicle's swaying. The camera, for example, captures an image of the area in front of the vehicle and provides information on whether the vehicle has departed from its lane, information on whether the vehicle has exceeded a stop line, and information on the distance between the vehicle and the preceding vehicle. The millimeter wave radar detects the distance between the vehicle and a preceding vehicle or an obstacle in front of the vehicle. The vehicle behavior information acquisition unit 25 may include all or part of the vehicle speed sensor, steering angle sensor, camera, and millimeter wave radar, or may include devices or sensors other than the above-mentioned vehicle speed sensor, steering angle sensor, camera, and millimeter wave radar as long as they can acquire information for detecting abnormal vehicle behavior.

[0016] The output unit 4 is a device that operates based on a signal output from the control unit 3, and includes, for example, a vehicle control unit 41, a speaker 42, and a monitor 43. The vehicle control unit 41 has control devices that receive a control signal output from the control unit 3 and perform braking control, drive control, and steering control of the vehicle. For example, the vehicle control unit 41 is composed of individual control devices that perform braking control, drive control, and steering control of the vehicle. The speaker 42 issues a voice call to the driver based on a signal output from the control unit 3. The speaker 42 functions as a notification unit that notifies the driver through hearing, and for example, operates in response to a voice signal from the control unit 3 and outputs a voice. The monitor 43 functions as a notification unit that notifies the driver through vision, and for example, a liquid crystal display or the like is used, and operates in response to a display signal from the control unit 3. In addition, the monitor 43 may not only function as a display device, but also be used as an input device by using a touch panel or the like.

[0017] The control unit 3 is a control unit that detects abnormalities in the driver, and is, for example, configured by a computer. The control unit 3 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., and performs abnormality detection by, for example, loading an abnormality detection program stored in the ROM into the RAM and executing it by the CPU.

[0018] The control unit 3 includes a motion detection unit 31, a behavior detection unit 32, a biological information detection unit 33, a voice detection unit 34, an abnormality sign determination unit 35, an abnormality determination unit 36, a vehicle control unit 37, a communication unit 38, and a storage unit 39. The motion detection unit 31, the behavior detection unit 32, the biological information detection unit 33, the voice detection unit 34, the abnormality sign determination unit 35, the abnormality determination unit 36, and the vehicle control unit 37 are configured, for example, by introducing an abnormality detection program into the control unit 3. In addition, the motion detection unit 31, the behavior detection unit 32, the biological information detection unit 33, the voice detection unit 34, the abnormality sign determination unit 35, the abnormality determination unit 36, and the vehicle control unit 37 may be configured as individual control units. The motion detection unit 31, the behavior detection unit 32, the biological information detection unit 33, and the voice detection unit 34 function as detection units that detect abnormality signs of the driver based on, for example, the motion information of the driver, biological information, and vehicle behavior information.

[0019] The motion detection unit 31 detects the motion of the driver, and detects the motion of the driver using an image analysis method or an image recognition method based on the image information output from the camera 21. As the image analysis method and image recognition method, a publicly known image analysis method and image recognition method may be used. The motion detection unit 31 detects the driver's posture, motion, facial expression, etc. For example, the motion detection unit 31 detects the motion of the driver in an abnormal state and the motion that is a sign of an abnormality in the driver. In addition, the motion detection unit 31 detects the motion related to the driver's illness.

[0020] Examples of abnormal driver behavior include driver's poor posture, letting go of the steering wheel, fainting, closing the eyes, rolling back the eyes, etc. Poor posture is a state in which the driver's posture is different from the normal driving posture, such as leaning against the seat and not gripping the steering wheel firmly, or the driver crouching down.

[0021] An example of the driver's abnormality prediction behavior is a pain prediction behavior when the driver feels pain in the body. The pain prediction behavior includes the driver's pain prediction behavior and facial expression, such as a motion of holding the chest, a motion of holding the head, a motion of holding the back, a motion of holding the shoulders, a motion of holding the neck, and a painful facial expression. The driver's pain prediction behavior is a motion of an abnormality prediction behavior before the driver becomes unable to drive. By the motion detection unit 31 detecting the pain prediction behavior, the abnormality detection device 1 can detect the driver's abnormality at an early stage. In addition, by including the motion of holding the chest, the motion of holding the head, and the motion of holding the back as the pain prediction behavior, the motion detection unit 31 can detect the abnormality prediction behavior of heart disease, brain disease, and arterial disease (aortic aneurysm, aortic dissection). It is said that more than 70% of accidents caused by driver's diseases are caused by heart disease, brain disease, and arterial disease. Therefore, by detecting the abnormality prediction behavior of heart disease, brain disease, and arterial disease, the safety of vehicle driving can be improved appropriately.

[0022] The behavior detection unit 32 detects the behavior of the vehicle, and detects abnormal behavior of the vehicle based on the behavior information acquired by the vehicle behavior information acquisition unit 25. For example, the behavior detection unit 32 detects abnormal behavior of the vehicle caused by a driver's abnormal sign. Specifically, the behavior detection unit 32 detects abnormal behavior of the vehicle such as departure from the vehicle's lane, swaying driving of the vehicle, delayed operation of the vehicle, crossing a stop line, driving with a risk of a forward collision, etc. Therefore, the behavior detection unit 32 functions as a vehicle behavior detection unit.

[0023] The biological information detection unit 33 detects the biological information of the driver, and detects biological information that is a sign of an abnormality in the driver, based on the biological information of the driver acquired by the biological information acquisition unit 22. For example, the biological information detection unit 33 detects all or some of the following: an increase in pulse rate above a predetermined value, a decrease in pulse rate below a predetermined value, an increase in blood pressure above a predetermined value, a decrease in blood pressure below a predetermined value, pulse wave abnormalities, arrhythmia, an increase in respiratory rate above a predetermined value, and a decrease in respiratory rate below a predetermined value.

[0024] The voice detection unit 34 detects the voice of the driver, and detects voice information that is a sign of an abnormality in the driver based on the voice information acquired by the microphone 23. For example, the voice detection unit 34 detects voice related to the driver's illness and detects voice that is a sign of an abnormality in the driver. For example, the voice detection unit 34 detects the driver's moans and screams as voices that are a sign of an abnormality in the driver. In this case, the voice detection unit 34 functions as a movement detection unit that detects the movement of the driver.

[0025] The abnormality sign determination unit 35 determines whether or not there is an abnormal sign of the driver. For example, the abnormality sign determination unit 35 determines whether or not there is an abnormal sign of the driver based on the detection results of the movement detection unit 31, the behavior detection unit 32, the biological information detection unit 33, and the voice detection unit 34. Specifically, the abnormality sign determination unit 35 determines that there is an abnormal sign of the driver when all or a part of the movement detection unit 31, the behavior detection unit 32, the biological information detection unit 33, and the voice detection unit 34 detect that there is an abnormal sign of the driver. The case where the movement detection unit 31, the behavior detection unit 32, the biological information detection unit 33, and a part of the voice detection unit 34 detect that there is an abnormal sign of the driver is, for example, the case where at least two of the movement detection unit 31, the behavior detection unit 32, the biological information detection unit 33, and the voice detection unit 34 detect that there is an abnormal sign of the driver. Specifically, the abnormality sign determination unit 35 determines that there is an abnormal sign of the driver when one or more of the action detection unit 31 and the biological information detection unit 33 detect that there is an abnormal sign of the driver and when the behavior detection unit 32 detects that there is an abnormal sign of the driver. In contrast, the abnormality sign determination unit 35 determines that there is no abnormal sign of the driver when the action detection unit 31 and the biological information detection unit 33 detect that there is no abnormal sign of the driver or when the behavior detection unit 32 detects that there is no abnormal sign of the driver. According to such an abnormality sign determination, erroneous detection of an abnormality sign can be suppressed by including the detection of an abnormal sign of the driver by the behavior detection unit 32 in the determination condition for the abnormality sign.

[0026] The abnormality determination unit 36 ​​determines whether the driver is in an abnormal state. For example, when the motion detection unit 31 detects that the driver has closed eyes, fainted, rolled eyes, or poor posture, the abnormality determination unit 36 ​​determines that the driver is incapable of driving and in an abnormal state. In this case, the abnormality determination unit 36 ​​determines that the driver is incapable of driving and in an abnormal state when the driver has closed eyes, fainted, rolled eyes, or poor posture for a preset period of time. Furthermore, the abnormality determination unit 36 ​​may determine that the driver is in an abnormal state when the driver is incapable of driving, even if the driver is not in a closed eyes, fainted, rolled eyes, or poor posture.

[0027] Furthermore, the abnormality determination unit 36 ​​determines that the driver is in an abnormal state when the abnormality sign determination unit 35 determines that there is an abnormal sign in the driver. By determining that the driver is in an abnormal state when there is an abnormal sign in the driver, the abnormality determination unit 36 ​​can detect the driver's abnormality early and can ensure the safety of vehicle driving by executing vehicle control early.

[0028] In addition, when the abnormality sign determination unit 35 determines that there are abnormality signs, the abnormality determination unit 36 ​​may activate the speaker 42 to call out to the driver to see if there are any abnormalities, and if there is no response from the driver, determine that the driver is in an abnormal state.

[0029] When the abnormality determination unit 36 ​​determines that the driver is in an abnormal state, the vehicle control unit 37 outputs a control signal to the vehicle control unit 41 to ensure the safety of vehicle driving. For example, the vehicle control unit 37 outputs a control signal to the vehicle control unit 41 to decelerate and stop the vehicle. Alternatively, the vehicle control unit 37 may output a control signal to the vehicle control unit 41 to automatically drive the vehicle to a position where the vehicle can be stopped safely, and stop the vehicle after determining the stopping position.

[0030] The communication unit 38 is a part that performs wireless communication with the outside of the control unit 3. For example, the communication unit 38 performs wireless communication with the biometric information acquisition unit 22 and acquires the biometric information of the driver.

[0031] The storage unit 39 stores information or data related to abnormality detection, etc. For example, the storage unit 39 stores an abnormality detection program, control data, etc.

[0032] Next, the operation of the abnormality detection device 1, an abnormality detection method, and an abnormality detection program according to this embodiment will be described.

[0033] Fig. 2 is a flowchart showing the operation, abnormality detection method, and abnormality detection program of the abnormality detection device 1. A series of control processes in the flowchart of Fig. 2 is started, for example, when the ignition or power switch of the vehicle is turned on, and is repeatedly executed by the control unit 3 at a predetermined cycle.

[0034] 2 (hereinafter, simply referred to as "S10"; the same applies to steps after S10), a step of reading information related to abnormality detection is performed. Information related to abnormality detection is, for example, information output from the camera 21, biometric information acquisition unit 22, and microphone 23, which is input to the control unit 3 and read.

[0035] Then, the process proceeds to S12, where a driver's motion detection process is performed. The motion detection process is a process of detecting the driver's motion, and is performed by the motion detection unit 31 using, for example, an image analysis method or an image recognition method based on image information output from the camera 21. The motion detection unit 31 detects motions related to the driver's illness, and detects motions in the driver's abnormal state and motions that are a sign of the driver's abnormality. The motion detection unit 31 detects the driver's posture loss, letting go of the steering wheel, fainting, closing the eyes, rolling back the eyes, and the like as motions in the driver's abnormal state. In addition, the motion detection unit 31 detects pain motions when the driver feels pain in the body as motions that are a sign of the driver's abnormality. Specifically, the motion detection unit 31 detects the motions of pain such as pressing the chest, pressing the head, pressing the back, pressing the shoulders, pressing the neck, and a painful facial expression as the motions of pain. In the motion detection process, by detecting the painful motions of the driver, it is possible to detect abnormal signs of heart disease, brain disease, and arterial disease. Therefore, the abnormality detection device 1, the abnormality detection method, and the abnormality detection program make it possible to accurately detect an abnormality in the driver at an early stage.

[0036] The movement detection step may be performed by the voice detection unit 34 using a voice analysis method or the like based on the voice information output from the microphone 23. The voice detection unit 34 detects voices related to the driver's illness and voices that are a sign of abnormality in the driver. For example, the voice detection unit 34 detects the driver's moans and screams as voices that are a sign of abnormality in the driver.

[0037] Then, the process proceeds to S14, where a vehicle behavior detection process is performed. The vehicle behavior detection process is a process for detecting the behavior of the vehicle, and is performed by the behavior detection unit 32 based on the behavior information acquired by the vehicle behavior information acquisition unit 25. For example, the behavior detection unit 32 detects abnormal vehicle behavior caused by a driver's abnormal sign. Specifically, the behavior detection unit 32 detects abnormal vehicle behavior such as lane departure, swaying of the vehicle, delayed operation of the vehicle, crossing a stop line, and driving that may cause a forward collision.

[0038] Then, the process proceeds to S16, where a biological information detection process is performed. The biological information detection process is a process of detecting the biological information of the driver, and is performed by the biological information detection unit 33. The biological information detection unit 33 detects biological information that is a sign of an abnormality in the driver. For example, the biological information detection unit 33 detects all or some of the following: an increase in pulse rate above a predetermined value, a decrease in pulse rate below a predetermined value, an increase in blood pressure above a predetermined value, a decrease in blood pressure below a predetermined value, pulse wave abnormalities, arrhythmia, an increase in respiratory rate above a predetermined number, and a decrease in respiratory rate below a predetermined number.

[0039] Then, the process proceeds to S18, where it is determined whether the driver is in an abnormal state. This process is performed by the abnormality determination unit 36. The abnormality determination unit 36 ​​determines whether the driver is in an abnormal state based on the detection result of the motion detection unit 31. For example, when the motion detection unit 31 detects that the driver has closed eyes, fainted, rolled eyes, or a poor posture, the abnormality determination unit 36 ​​determines that the driver is in an incapable state of driving and is in an abnormal state. On the other hand, when the motion detection unit 31 detects that the driver is not in any of the closed eyes, fainted, rolled eyes, and poor posture, the abnormality determination unit 36 ​​determines that the driver is not in an abnormal state. Note that the abnormality determination unit 36 ​​may determine that the driver is in an abnormal state if the driver is incapable of driving, even if the driver is not in the closed eyes, fainted, rolled eyes, or poor posture.

[0040] If it is determined in S18 that the driver is in an abnormal state, the process proceeds to S22, where an abnormality determination process is performed. This abnormality determination process is a process for setting or making the control unit 3 recognize that the driver is in an abnormal state. For example, the abnormality determination unit 36 ​​sets a flag indicating an abnormal state, and makes the control unit 3 recognize that the driver is in an abnormal state.

[0041] On the other hand, if it is determined in S18 that the driver is not in an abnormal state, the process proceeds to S20, where it is determined whether or not the driver has an abnormal sign. This process is performed by the abnormal sign determination unit 35. The abnormal sign determination unit 35 determines whether or not the driver has an abnormal sign based on the detection results of the motion detection unit 31, the behavior detection unit 32, the biological information detection unit 33, and the voice detection unit 34. Specifically, the abnormal sign determination unit 35 determines that the driver has an abnormal sign when all or some of the motion detection unit 31, the behavior detection unit 32, the biological information detection unit 33, and the voice detection unit 34 detect that the driver has an abnormal sign. On the other hand, the abnormal sign determination unit 35 determines that the driver does not have an abnormal sign when all of the motion detection unit 31, the behavior detection unit 32, the biological information detection unit 33, and the voice detection unit 34 detect that the driver does not have an abnormal sign.

[0042] Furthermore, the abnormality sign determination unit 35 may determine that there is a sign of an abnormality in the driver when at least two of the motion detection unit 31, the behavior detection unit 32, the biometric information detection unit 33, and the voice detection unit 34 detect that there is a sign of an abnormality in the driver. In this case, the abnormality sign determination unit 35 determines that there is no sign of an abnormality in the driver when all of the motion detection unit 31, the behavior detection unit 32, the biometric information detection unit 33, and the voice detection unit 34 detect that there is no sign of an abnormality in the driver, and when one of the motion detection unit 31, the behavior detection unit 32, the biometric information detection unit 33, and the voice detection unit 34 detects that there is a sign of an abnormality in the driver.

[0043] Furthermore, the abnormality sign determination unit 35 may determine that there is an abnormal sign of the driver when one or more of the motion detection unit 31, the biometric information detection unit 33, and the voice detection unit 34 detect that there is an abnormal sign of the driver, and when the behavior detection unit 32 detects that there is an abnormal sign of the driver. In this case, the abnormality sign determination unit 35 determines that there is no abnormal sign of the driver when all of the motion detection unit 31, the biometric information detection unit 33, and the voice detection unit 34 detect that there is no abnormal sign of the driver, or when the behavior detection unit 32 detects that there is no abnormal sign of the driver. The abnormality sign determination unit 35 determines that there is an abnormal sign of the driver when abnormal behavior of the vehicle is detected in this manner, thereby suppressing erroneous determination of an abnormal sign of the driver.

[0044] Furthermore, the abnormality sign determination unit 35 may determine whether or not the driver has an abnormal sign based on the detection results of the motion detection unit 31, the behavior detection unit 32, the biological information detection unit 33, and the voice detection unit 34, and then call out to the driver via the speaker 42 as to whether or not he or she is able to drive, and determine that the driver has an abnormal sign or is in an abnormal state if there is no response from the driver. In this case, the abnormality sign determination unit 35 determines that the driver has no abnormal sign if there is a response from the driver.

[0045] If it is determined in S20 that the driver has no abnormality signs, the series of control processes in Fig. 2 ends. On the other hand, if it is determined in S20 that the driver has abnormality signs, the process proceeds to the abnormality determination step of S22. In this case, the driver is not in an abnormal state, but by setting or recognizing the driver as in an abnormal state at the stage of abnormality signs that are likely to lead to an abnormal state, it becomes possible to respond in the same way as if the driver were in an abnormal state. Therefore, the abnormality detection device 1 can ensure the safety of vehicle driving.

[0046] Then, the process proceeds to S24, where the vehicle control process is performed. The vehicle control process is performed by the vehicle control unit 37. The vehicle control unit 37 outputs a control signal to the vehicle control unit 41 to drive the vehicle safely or stop the vehicle. For example, the vehicle control unit 37 automatically drives the vehicle to a position where the vehicle can be safely stopped, and stops the vehicle after determining the stopping position. In addition, the vehicle control unit 37 may automatically drive the vehicle toward the destination as much as possible when the destination is set by a navigation system or the like. In addition, the vehicle control unit 37 may automatically notify an emergency or the like after the vehicle is stopped. In this case, the biological information and image information detected by the abnormality detection device 1 can be shared with emergency facilities with the prior consent of the driver, thereby enabling prompt lifesaving. Then, after the vehicle control process of S24 is completed, the series of control processes in FIG. 2 is terminated.

[0047] As described above, the abnormality detection device 1, abnormality detection method, and abnormality detection program of this embodiment can accurately detect signs of an abnormality occurring in the driver by detecting abnormal signs based on the driver's operation information, biometric information, and abnormal behavior of the vehicle and determining whether or not there is an abnormality, thereby enabling early detection of an abnormality in the driver with high accuracy.

[0048] The abnormality detection device 1, abnormality detection method, and abnormality detection program according to the present embodiment determine that there is a sign of abnormality in the driver's body when one or more of the motion detection unit 31 and the biological information detection unit 33 detect a sign of abnormality in the driver and when the behavior detection unit 32 detects a sign of abnormality in the driver. As a result, the abnormality detection device 1, abnormality detection method, and abnormality detection program according to the present embodiment can suppress erroneous detection of a sign of abnormality in the driver and can accurately detect an abnormality in the driver at an early stage.

[0049] Furthermore, the abnormality detection device 1, the abnormality detection method, and the abnormality detection program according to the present embodiment can accurately detect a sign of an abnormality occurring due to the driver's illness by detecting the driver's pain motion when the driver experiences pain associated with the driver's illness. Therefore, the abnormality detection device 1, the abnormality detection method, and the abnormality detection program according to the present embodiment can accurately detect an abnormality in the driver at an early stage.

[0050] For example, as shown in FIG. 3, taking angina pectoris, which is a heart disease, as an example, when a driver develops angina pectoris, plaque (lipids) occurs in the coronary artery, narrowing the coronary artery. At this time, the driver feels short of breath and feels a strange sensation in the chest and shoulders. As a result, the driver touches his chest and shoulders frequently, the driver's breathing rate increases, and the driver enters a state of abnormal premonition. This causes a delay in vehicle operation, and the vehicle speed increases or slows down. Then, the narrowing of the coronary artery causes poor blood flow. At this time, the driver feels a pain as if the shoulders, chest, neck, etc. are being squeezed, and palpitations or dizziness occur. Therefore, the driver performs a pain motion of holding the chest, shoulders, and neck. Also, the driver's heart rate and blood pressure increase due to the pain. That is, the driver's state of abnormal premonition continues. This causes the vehicle to stagger and delay in operation, leading to the risk of collision, overshooting the stop lane, etc. Then, the supply of blood (oxygen) to the heart becomes insufficient, and the driver's movements become sluggish. As a result, the driver loses consciousness and faints. This causes the driver to lose his / her posture (face up, face down, or sideways), making him / her unable to drive and in an abnormal state. In this way, the abnormality detection device 1, abnormality detection method, and abnormality detection program according to this embodiment can detect the driver's painful movements when the driver experiences pain associated with an illness, biological information that is a sign of an abnormality, and abnormal behavior of the vehicle, thereby detecting that the driver is in an abnormal state at the stage of an abnormality sign before the driver becomes unable to drive. Therefore, the abnormality detection device 1, abnormality detection method, and abnormality detection program according to this embodiment can detect an abnormality in the driver at an early stage.

[0051] In addition, the abnormality detection device 1, abnormality detection method, and abnormality detection program of this embodiment can accurately detect abnormal signs associated with illness by detecting the driver's pain-inducing movements, such as pressing on the chest, pressing on the head, and pressing on the back.

[0052] The abnormality detection device, the abnormality detection method, and the abnormality detection program according to the present invention are not limited to the above-described embodiment, and various modifications are possible within the scope of the claims. The abnormality detection device 1, the abnormality detection method, and the abnormality detection program according to the present embodiment may be configured by appropriately combining the components of the above-described embodiment and modified examples. [Explanation of symbols]

[0053] 1: Anomaly detection device 21: Camera (motion acquisition unit) 22: Biometric information acquisition unit 25: Vehicle behavior information acquisition unit (behavior acquisition unit) 31: Motion detection unit 32: Behavior detection unit 33: Biometric information detection unit 35: Abnormality prediction unit

Claims

1. an input unit for inputting motion information, biological information, and behavior information of a driver of a vehicle; a detection unit that detects a sign of an abnormality of the driver based on the operation information, the biological information, and the behavior information; and an abnormality sign determination unit that determines whether or not there is an abnormality sign in the body of the driver based on the detection result of the detection unit. Anomaly detection device.

2. the input unit includes an action acquisition unit that acquires the action information, a behavior acquisition unit that acquires behavior information of the vehicle, and a biometric information acquisition unit that acquires biometric information of the driver; the detection unit includes a motion detection unit that detects a painful motion associated with a physical illness of the driver based on the motion information acquired by the motion acquisition unit, a behavior detection unit that detects an abnormal behavior of the vehicle based on the behavior information acquired by the behavior acquisition unit, and a biological information detection unit that detects the biological information that is a sign of an abnormality in the driver based on the biological information acquired by the biological information acquisition unit, the abnormality sign determination unit determines that there is a physical abnormality sign of the driver when one or more of the motion detection unit and the biological information detection unit detect an abnormality sign of the driver and the behavior detection unit detects an abnormality sign of the driver, The abnormality detection device according to claim 1 .

3. The action acquisition unit is a camera that captures an image of the driver, The motion detection unit is capable of detecting at least a pain motion of the driver when the driver experiences pain due to an illness of the driver. The abnormality detection device according to claim 2 .

4. The motion detection unit is capable of detecting at least a motion of pressing on the chest, a motion of pressing on the head, and a motion of pressing on the back as the pain motion. The abnormality detection device according to claim 3 .

5. an input step of inputting motion information, biometric information, and behavior information of a driver of a vehicle; a detection step of detecting a sign of an abnormality of the driver based on the operation information, the biological information, and the behavior information; and an abnormality sign determination step of determining whether or not there is an abnormality sign in the body of the driver based on the detection result of the detection step. Anomaly detection methods.

6. An abnormality detection program that causes a computer to detect an abnormality in a driver of a vehicle, an input step of inputting motion information, biometric information, and behavior information of the vehicle driver; a detection step of detecting a sign of an abnormality of the driver based on the operation information, the biological information, and the behavior information; an abnormality sign determination step of determining whether or not there is an abnormality sign in the body of the driver based on the detection result of the detection step; Anomaly detection programs.

Images