Intoxication determination device and intoxication determination method
The breathalyzer determination device addresses the issue of inaccurate sobriety detection by using video and vital sign analysis to assess alcohol consumption, enhancing the accuracy of determining a vehicle occupant's drunken state.
Patent Information
- Application Number
- PCT/JP2023/019830
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-29
- Publication Date
- 2024-12-05
AI Technical Summary
Existing sobriety determination devices inaccurately detect a vehicle occupant's drunken state due to variations in complexion and temperature, leading to erroneous results.
A breathalyzer determination device that includes a video acquisition unit, a beverage intake behavior determination unit, and a vital information acquisition unit to assess the occupant's behavior and vital signs, reducing erroneous detection by determining if the occupant has consumed alcohol based on observed behavior and vital information.
The device effectively reduces erroneous detection of a drinking state by accurately determining if the occupant has ingested alcohol, thereby improving the reliability of sobriety assessments.
Smart Images

Figure JP2023019830_05122024_PF_FP_ABST
Abstract
Description
Drinking alcohol determination device and drinking alcohol determination method
[0001] The present disclosure relates to a drinking determination device and a drinking determination method.
[0002] There is a drinking determination device that determines whether a vehicle occupant has consumed alcohol (hereinafter referred to as "drunk state"). For example, Patent Document 1 discloses an example of such a drinking determination device, which is a monitoring device that acquires a video of the occupant from a camera that captures the occupant in the vehicle, and determines whether the occupant has consumed alcohol based on the facial color or temperature of the occupant captured in the video.
[0003] JP 2010-186251 A
[0004] The monitoring device disclosed in Patent Document 1 detects whether an occupant has drunk alcohol based on video captured by a camera, which can lead to a false detection of the occupant's drinking status. Occupant complexions and body temperatures vary from person to person. Therefore, even if an occupant has not drunk alcohol, the occupant's complexion may turn red, and the occupant's body temperature may rise. In such cases, the occupant's drinking status may be falsely detected.
[0005] The present disclosure has been made to solve the above-mentioned problems, and aims to provide a drinking judgment device that can reduce false detection of drinking status compared to the monitoring device disclosed in Patent Document 1.
[0006] The drinking determination device according to the present disclosure includes a video acquisition unit that acquires video footage of a vehicle occupant, a beverage intake behavior determination unit that determines whether the occupant has taken the action of consuming a beverage inside the vehicle based on the video footage acquired by the video acquisition unit, a vital information acquisition unit that acquires vital information of the occupant, and, if the beverage intake behavior determination unit determines that the occupant has taken the action of consuming a beverage, a drinking state determination unit that determines whether the occupant has consumed alcohol based on the vital information acquired by the vital information acquisition unit.
[0007] According to the present disclosure, it is possible to reduce false detection of drinking levels compared to the monitoring device disclosed in Patent Document 1.
[0008] 5A is an explanatory diagram showing a state in which an occupant holds the top of a container to his / her mouth and starts drinking, and FIG. 5B is an explanatory diagram showing a state in which an occupant holds the top of a container to his / her mouth while drinking. FIG. 5B is an explanatory diagram showing a state in which an occupant holds the top of a container to his / her mouth and drinks. FIG. 5B is an explanatory diagram showing a state in which an occupant holds the top of a container to his / her mouth while drinking. FIG. 5A is a hardware configuration diagram showing the drinking determination device 3 according to embodiment 1. FIG. 5B is a hardware configuration diagram showing the drinking determination device 3 according to embodiment 2. FIG. 5B is a hardware configuration diagram showing the drinking determination device 3 according to embodiment 3. FIG. 5C is a hardware configuration diagram showing the drinking determination device 3 according to embodiment 4. FIG. 5D is a hardware configuration diagram showing the drinking determination device 3 according to embodiment 4.
[0009] In order to explain the present disclosure in more detail, embodiments of the present disclosure will be described below with reference to the accompanying drawings.
[0010] Embodiment 1. Fig. 1 is a configuration diagram showing a drinking alcohol determination device 3 according to embodiment 1. Fig. 2 is a hardware configuration diagram showing the hardware of the drinking alcohol determination device 3 according to embodiment 1. The drinking alcohol determination device 3 shown in Fig. 1 includes an image acquisition unit 11, a beverage intake behavior determination unit 12, a vital information acquisition unit 13, a drinking state determination unit 14, and a warning output unit 15.
[0011] The camera 1 is installed, for example, on the instrument panel, ceiling, A-pillar, or windshield of the vehicle. The camera 1 captures images of the occupants in the vehicle and transmits the captured images of the occupants to the drinking alcohol determination device 3. In the drinking alcohol determination device 3 shown in FIG. 1, the occupant is assumed to be the driver of the vehicle. However, the occupant is not limited to the driver of the vehicle, and may be an occupant other than the driver.
[0012] The vital sensor 2 is installed, for example, in the passenger compartment of the vehicle. However, this is merely an example, and the vital sensor 2 may be worn on the wrist or the like of the occupant. The vital sensor 2 measures vital signs such as the occupant's heart rate and transmits vital information indicating the occupant's vital signs to the drinking determination device 3. The vital sensor 2 installed in the passenger compartment of the vehicle measures the occupant's vital signs without contacting the occupant. For example, the vital sensor 2 uses a built-in camera to photograph the occupant and measures the occupant's vital signs based on the photographed image of the occupant. The vital sensor 2 worn on the wrist or the like of the occupant directly measures the occupant's heart rate. For this reason, the vital sensor 2 worn on the wrist or the like of the occupant generally has higher measurement accuracy than the vital sensor 2 installed in the passenger compartment of the vehicle.
[0013] The video acquisition unit 11 is realized by, for example, a video acquisition circuit 21 shown in Fig. 2. The video acquisition unit 11 acquires video of a vehicle occupant from the camera 1. The video acquisition unit 11 outputs the video of the occupant to the beverage intake behavior determination unit 12, the vital information acquisition unit 13, and the drinking state determination unit 14, respectively.
[0014] The beverage intake behavior determination unit 12 is realized, for example, by the beverage intake behavior determination circuit 22 shown in Fig. 2. The beverage intake behavior determination unit 12 acquires a captured video of the occupant from the video acquisition unit 11. The beverage intake behavior determination unit 12 determines whether the occupant has taken a behavior of consuming a beverage inside the vehicle based on the captured video. The beverage intake behavior determination unit 12 outputs a determination result indicating whether the occupant has taken a behavior of consuming a beverage to the drinking level determination unit 14.
[0015] The vital information acquisition unit 13 is realized, for example, by a vital information acquisition circuit 23 shown in FIG. 2 . The vital information acquisition unit 13 acquires vital information indicating the vital signs of the occupant from the vital sensor 2. The vital information acquisition unit 13 outputs the vital information to the drinking level determination unit 14. In the drinking determination device 3 shown in FIG. 1 , the vital information acquisition unit 13 acquires the vital information from the vital sensor 2. However, this is merely an example, and the vital information acquisition unit 13 may also acquire captured video from the video acquisition unit 11. In this case, the vital information acquisition unit 13 acquires the occupant's pulse rate or heart rate, etc. as vital information of the occupant based on the captured video, and outputs the vital information indicating the occupant's pulse rate, etc. to the drinking level determination unit 14.
[0016] The drinking level determination unit 14 is realized, for example, by the drinking level determination circuit 24 shown in FIG. 2 . The drinking level determination unit 14 acquires a determination result from the beverage intake behavior determination unit 12 and acquires vital sign information from the vital sign information acquisition unit 13. When the beverage intake behavior determination unit 12 determines that the occupant has taken a beverage, the drinking level determination unit 14 determines whether the occupant has consumed alcohol (hereinafter referred to as "drinking state") based on the vital sign information. The drinking level determination unit 14 outputs a determination result indicating whether the occupant has consumed alcohol to the warning output unit 15. In the drinking determination device 3 shown in FIG. 1 , the drinking level determination unit 14 determines whether the occupant has consumed alcohol based on the vital sign information. However, this is merely an example, and the drinking level determination unit 14 may also determine whether the occupant has consumed alcohol based on the captured video acquired by the video acquisition unit 11.
[0017] The warning output unit 15 is realized by, for example, the warning output circuit 25 shown in Fig. 2. The warning output unit 15 obtains a determination result indicating whether or not the occupant is drunk from the drinking level determination unit 14. If the drinking level determination unit 14 determines that the occupant is drunk, the warning output unit 15 outputs a warning to the occupant. Specifically, the warning output unit 15 outputs warning information to the vehicle control device 4, thereby causing the vehicle control device 4 to output a warning.
[0018] When the vehicle control device 4 receives warning information from the warning output unit 15, the vehicle control device 4, for example, displays a warning on the instrument panel of the vehicle. Furthermore, when the vehicle control device 4 receives warning information from the warning output unit 15, the vehicle control device 4 controls the vehicle, for example, to pull over to the shoulder of the road and then stop the vehicle.
[0019] 1, it is assumed that each of the components of the drinking determination device 3, namely, the image acquisition unit 11, the beverage intake behavior determination unit 12, the vital information acquisition unit 13, the drinking state determination unit 14, and the warning output unit 15, is realized by dedicated hardware such as that shown in FIG. 2. That is, it is assumed that the drinking determination device 3 is realized by an image acquisition circuit 21, a beverage intake behavior determination circuit 22, a vital information acquisition circuit 23, a drinking state determination circuit 24, and a warning output circuit 25. Each of the image acquisition circuit 21, the beverage intake behavior determination circuit 22, the vital information acquisition circuit 23, the drinking state determination circuit 24, and the warning output circuit 25 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof.
[0020] The components of the drinking determination device 3 are not limited to those realized by dedicated hardware, and the drinking determination device 3 may be realized by software, firmware, or a combination of software and firmware. Software or firmware is stored as a program in the memory of a computer. A computer refers to hardware that executes a program, and includes, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a processor, or a DSP (Digital Signal Processor).
[0021] 3 is a hardware configuration diagram of a computer when the drinking alcohol determination device 3 is realized by software, firmware, etc. When the drinking alcohol determination device 3 is realized by software, firmware, etc., a program for causing the computer to execute the processing procedures of the image acquisition unit 11, the beverage intake behavior determination unit 12, the vital information acquisition unit 13, the drinking state determination unit 14, and the warning output unit 15 is stored in a memory 31. A processor 32 of the computer then executes the program stored in the memory 31.
[0022] 2 shows an example in which each of the components of the drinking determination device 3 is realized by dedicated hardware, while Fig. 3 shows an example in which the drinking determination device 3 is realized by software, firmware, etc. However, this is merely an example, and some of the components of the drinking determination device 3 may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.
[0023] Next, the operation of the drinking alcohol determination device 3 shown in Fig. 1 will be described. The camera 1 captures images of the occupants in the vehicle and transmits the captured images of the occupants to the drinking alcohol determination device 3. The captured images of the occupants may be not only moving images but also multiple still images arranged in time series. The vital sensor 2 measures the occupants' vital signs, such as their heart rate, and transmits vital information indicating the occupants' vital signs to the drinking alcohol determination device 3.
[0024] 4 is a flowchart showing the drinking level determination method, which is the processing procedure of the drinking level determination device 3. The video acquisition unit 11 acquires video of the occupant from the camera 1 (step ST1 in FIG. 4). The video acquisition unit 11 outputs the video of the occupant to the drinking behavior determination unit 12. When the vital information acquisition unit 13 uses the video of the occupant to acquire vital information, the video acquisition unit 11 also outputs the video to the vital information acquisition unit 13. When the drinking level determination unit 14 uses the video of the occupant to determine the drinking level, the video acquisition unit 11 also outputs the video to the drinking level determination unit 14.
[0025] The beverage intake behavior determination unit 12 acquires a captured image of the occupant from the image acquisition unit 11. The beverage intake behavior determination unit 12 determines whether the occupant has taken a beverage in the vehicle based on the captured image (step ST2 in FIG. 4 ). The beverage intake behavior determination unit 12 outputs a determination result indicating whether the occupant has taken a beverage to the drinking level determination unit 14. The process of determining a beverage intake behavior by the beverage intake behavior determination unit 12 will be described in detail below.
[0026] The beverage intake behavior determination unit 12 performs a process of detecting whether the occupant's hands are gripping a container such as a cup, glass, can, or glass bottle by analyzing the captured video of the occupant. The process of detecting whether the occupant's hands are gripping a container is a known technique, and therefore a detailed description thereof will be omitted. When the beverage intake behavior determination unit 12 detects that the occupant's hands are gripping a container, it detects a change in the position of the occupant's head, a change in the position of the occupant's hands, and a change in the angle of the occupant's head from the captured video of the occupant. The occupant's head here refers to the area above the occupant's neck and includes the occupant's entire face.
[0027] As shown in FIG. 5 , the beverage intake behavior determination unit 12 detects whether the distance between the head position and the hand position is within a set distance range SDR based on changes in the head position and changes in the hand position. In the example of FIG. 5 , the beverage intake behavior determination unit 12 detects a change in the mouth position as the head position. FIG. 5A is an explanatory diagram showing a state in which an occupant places the drinking spout of a container over their mouth and begins drinking. FIG. 5B is an explanatory diagram showing a state in which an occupant drinks while holding the drinking spout of a container over their mouth. If the distance L between the occupant's mouth position and the hand position is outside the set distance range SDR, the occupant is unlikely to drink. On the other hand, if the distance L between the occupant's mouth position and the hand position is within the set distance range SDR, the occupant is likely to drink. The set distance range SDR is determined according to the size of the container. For example, the minimum value of the set distance range SDR is set to 0 [cm], and the maximum value of the set distance range SDR is set to a value that is greater than the height dimension of the container by △△ [cm]. The set distance range SDR may be stored in an internal memory of the beverage intake behavior determination unit 12 or may be provided from outside the drinking determination device 3 .
[0028] When a passenger holds the top of the container to his or her mouth to drink alcohol, the distance L between the position of the mouth and the position of the hand hardly changes while the passenger is drinking, as shown in Figures 5A and 5B. When the passenger actually drinks alcohol, the angle θ of the head often changes so that the face turns upward, as shown in Figure 5B.
[0029] If the distance L between the mouth position and the hand position falls within the set distance range SDR, there is a high possibility that the occupant will drink alcohol. Therefore, as shown in Figures 5A and 5B, when the distance L between the mouth position and the hand position remains almost unchanged, the beverage intake behavior determination unit 12 detects whether the head angle θ has changed so that the face is facing upward. The determination of whether the distance L remains almost unchanged is made by determining whether the change ΔL in the distance L is greater than or equal to the threshold L th This can be determined by checking whether a state in which the threshold value L is less than or equal to the threshold value L continues. thmay be stored in the internal memory of the beverage intake behavior determination unit 12, or may be provided from outside the drinking determination device 3. The distance L between the position of the mouth and the position of the hand may be, for example, the distance between the position of the occupant's lower lip and the position of the thumb. The position of the lower lip may be, for example, the center of the lower lip or the edge of the lower lip. The position of the thumb may be, for example, the tip of the thumb, the joint of the thumb, or the base of the thumb.
[0030] The head angle θ is the angle between the vertical direction and a line segment connecting the center of the neck and the center of the top of the head. The process of calculating the head angle θ based on the captured video of the occupant is a well-known technique, and therefore a detailed description thereof will be omitted. In the example of FIG. 5A , the head angle θ of the occupant is 0 degrees when the occupant starts drinking. In the example of FIG. 5B , the occupant tilts his head to face up to drink, causing the head angle θ to be greater than 0 degrees. If the head angle θ changes so that the face faces up when the distance L between the mouth position and the hand position is almost unchanged, the beverage intake behavior determination unit 12 outputs a determination result indicating that the occupant has taken the action of consuming a beverage to the drinking state determination unit 14. If the beverage intake behavior determination unit 12 does not detect a state in which the distance L between the mouth position and the hand position is almost unchanged, or if the head angle θ does not change so that the face faces up in this state even when the distance L is almost unchanged, the beverage intake behavior determination unit 12 outputs a determination result indicating that the occupant has not taken the action of consuming a beverage to the drinking state determination unit 14.
[0031] In the drinking behavior determination device 3 shown in FIG. 1 , when the beverage intake behavior determination unit 12 detects that the occupant's hands are gripping a container, it detects changes in the position of the occupant's head, the position of the occupant's hands, and the angle of the occupant's head from the captured video of the occupant, and determines whether the occupant has engaged in an action to consume a beverage based on the changes in the position of the head, the position of the hands, and the angle of the head. However, because the container is small, the container may be hidden by the occupant's hands when the occupant is gripping the container. In such cases, it may be impossible to detect that the occupant's hands are gripping the container. Therefore, the beverage intake behavior determination unit 12 may determine whether the occupant has engaged in an action to consume a beverage based on the changes in the position of the head, the position of the hands, and the angle of the head even when it cannot detect that the occupant's hands are gripping the container.
[0032] In the drinking determination device 3 shown in FIG. 1 , the beverage intake behavior determination unit 12 determines whether the occupant has taken an action to consume a beverage based on changes in head position, hand position, and head angle. However, since the occupant may drink alcohol through a straw, the beverage intake behavior determination unit 12 may determine that the occupant has taken an action to consume a beverage if it detects from the captured video of the occupant that the occupant has a straw in their mouth. In the drinking determination device 3 shown in FIG. 1 , the beverage intake behavior determination unit 12 determines whether the occupant has taken an action to consume a beverage based on changes in head position, hand position, and head angle. However, this is merely one example, and the beverage intake behavior determination unit 12 may also determine that the occupant has taken an action to consume a beverage if it detects from the captured video of the occupant that a part of the occupant's mouth is covered by a container.
[0033] In the drinking alcohol determination device 3 shown in Fig. 1, the beverage intake behavior determination unit 12 determines whether the occupant has taken an action to consume a beverage based on the captured video of the occupant. The beverage intake behavior determination unit 12 may determine whether the occupant has taken an action to consume a beverage based on the captured video of the occupant when a sensor signal from a sensor (not shown) that detects the odor of alcohol indicates that the odor of alcohol has been detected. In this way, using the sensor signal from the sensor that detects the odor of alcohol can improve the determination accuracy of the beverage intake behavior determination unit 12.
[0034] The beverage intake behavior determination unit 12 may also provide a captured video of the occupant to a first learning model (not shown) and obtain a determination result indicating whether or not the occupant has taken an action to consume a beverage from the first learning model. The first learning model is realized, for example, by a neural network. The first learning model is provided with first learning data and second learning data during learning. The first learning data includes captured video of the occupant taking an action to consume a beverage and training data indicating that the occupant is taking an action to consume a beverage. The second learning data includes captured video of the occupant not taking an action to consume a beverage and training data indicating that the occupant is not taking an action to consume a beverage. When the first learning data is provided, the first learning model learns from the captured video of the occupant taking an action to consume a beverage, and when the second learning data is provided, the first learning model learns from the captured video of the occupant not taking an action to consume a beverage. During inference, when the first learning model is given a captured image acquired by the image acquisition unit 11, it outputs a determination result indicating whether or not the subject has taken the action of consuming a beverage.
[0035] The vital information acquisition unit 13 acquires vital information indicating the vital signs of the occupant from the vital sensor 2 (step ST3 in FIG. 4 ). The vital information acquisition unit 13 outputs the vital information to the drinking level determination unit 14. In the drinking determination device 3 shown in FIG. 1 , the vital information acquisition unit 13 acquires vital information from the vital sensor 2. However, this is merely an example, and the vital information acquisition unit 13 may acquire captured video from the video acquisition unit 11. In this case, the vital information acquisition unit 13 acquires the occupant's pulse rate or heart rate, etc. as vital information of the occupant based on the captured video, and outputs vital information indicating the occupant's pulse rate, etc. to the drinking level determination unit 14. The process of measuring vital signs such as pulse rate based on captured video is a well-known technique, and therefore a detailed description thereof will be omitted.
[0036] The drinking level determination unit 14 obtains the determination result from the beverage intake behavior determination unit 12 and obtains vital information from the vital information acquisition unit 13. If the beverage intake behavior determination unit 12 determines that the occupant has taken a beverage (step ST4 in FIG. 4: YES), the drinking level determination unit 14 determines whether the occupant is drinking alcohol based on the vital information (step ST5 in FIG. 4). The drinking level determination process performed by the drinking level determination unit 14 will be described in detail below.
[0037] The memory of the drinking level determination unit 14 records the heart rate or pulse rate of the occupant when they are not drinking. For example, the heart rate, etc., of the occupant when they are not drinking can be the heart rate indicated by the vital information output from the vital information acquisition unit 13 when the sober occupant gets into the vehicle. When the beverage intake behavior determination unit 12 determines that the occupant has taken an action to consume a beverage, the drinking level determination unit 14 acquires vital information from the vital information acquisition unit 13. The drinking level determination unit 14 then compares the heart rate, etc., indicated by the vital information with the heart rate, etc., recorded in the memory. The drinking level determination unit 14 determines whether the occupant is drinking based on the comparison result of the heart rate, etc. The drinking level determination process itself based on the comparison result of the heart rate, etc., is a well-known technique, and therefore a detailed description thereof will be omitted. It is generally known that the heart rate, etc., increases as the occupant becomes more intoxicated with alcohol consumption.
[0038] In the alcohol consumption determination device 3 shown in FIG. 1 , the alcohol consumption level determination unit 14 determines whether the occupant is drinking alcohol based on a comparison result of heart rate, etc. However, this is merely an example, and the alcohol consumption level determination unit 14 may provide the occupant's vital sign information to a second learning model (not shown) and obtain a drinking state determination result from the second learning model. The second learning model is realized, for example, by a neural network. During learning, the second learning model is provided with third learning data and fourth learning data. The third learning data includes vital sign information when the occupant is drinking alcohol and training data indicating that the occupant is drinking alcohol. The fourth learning data includes vital sign information when the occupant is not drinking alcohol and training data indicating that the occupant is not drinking alcohol. When provided with the third learning data, the second learning model learns vital sign information when the occupant is drinking alcohol, and when provided with the second learning data, it learns vital sign information when the occupant is not drinking alcohol. The second learning model outputs a drinking state determination result when given vital information during inference.
[0039] In the drinking state determination device 3 shown in FIG. 1 , the drinking state determination unit 14 determines whether the occupant is drinking based on the vital information output from the vital information acquisition unit 13. However, this is merely an example, and the drinking state determination unit 14 may also determine whether the occupant is drinking based on the captured video acquired by the video acquisition unit 11. In this case, the drinking state determination unit 14 detects the number of times the occupant looks down within a certain period of time by detecting a change in the position of the occupant's head based on the captured video of the occupant. The drinking state determination unit 14 also detects the number of times the occupant yawns within a certain period of time based on the captured video of the occupant. The drinking state determination unit 14 may then determine that the occupant is drinking if at least one of the number of times the occupant looks down and the number of times the occupant yawns exceeds a reference number.
[0040] Here, the drinking level determination unit 14 determines whether the occupant is drinking alcohol based on the captured video acquired by the video acquisition unit 11. However, this is merely an example, and the drinking level determination unit 14 may provide the captured video of the occupant to a third learning model (not shown) and acquire a drinking level determination result from the third learning model. The third learning model is realized, for example, by a neural network. The third learning model is provided with fifth learning data and sixth learning data during learning. The fifth learning data includes video of the occupant drinking alcohol and training data indicating that the occupant is drinking alcohol. The sixth learning data includes video of the occupant not drinking alcohol and training data indicating that the occupant is not drinking alcohol. When the fifth learning data is provided to the third learning model, the third learning model learns from the video of the occupant drinking alcohol, and when the sixth learning data is provided, the third learning model learns from the video of the occupant not drinking alcohol. The third learning model outputs a drinking state determination result when a captured video acquired by the video acquisition unit 11 is given during inference.
[0041] The drinking state determination unit 14 outputs a determination result indicating whether or not the occupant is drinking to the warning output unit 15. In the drinking determination device 3 shown in FIG. 1 , if the beverage intake behavior determination unit 12 determines that the occupant has not taken a beverage (step ST4 in FIG. 4 : NO), the drinking state determination unit 14 does not perform the process of determining whether or not the occupant is drinking. The beverage intake behavior determination unit 12 determines whether or not the occupant is drinking only when the occupant has taken a beverage, thereby preventing the occurrence of an erroneous determination that the occupant is drinking when the occupant has not taken a beverage. If the beverage intake behavior determination unit 12 does not determine that the occupant has taken a beverage, the drinking state determination unit 14 does not perform the process of determining whether or not the occupant has taken a beverage, thereby reducing the processing load of the drinking determination device 3.
[0042] The warning output unit 15 acquires a determination result indicating whether or not the occupant is drunk from the drinking level determination unit 14. If the drinking level determination unit 14 determines that the occupant is drunk (YES in step ST6 of FIG. 4 ), the warning output unit 15 outputs warning information to the vehicle control device 4, thereby causing the vehicle control device 4 to output a warning. If the drinking level determination unit 14 determines that the occupant is not drunk (NO in step ST6 of FIG. 4 ), the warning output unit 15 does not output warning information to the vehicle control device 4.
[0043] When warning information is output from the warning output unit 15, the vehicle control device 4, for example, displays a warning on the instrument panel of the vehicle. Furthermore, when the vehicle control device 4 acquires warning information from the warning output unit 15, the vehicle control device 4 controls the vehicle, for example, to pull over to the shoulder of the road and then stop the vehicle.
[0044] In the first embodiment described above, the drinking determination device 3 is configured to include an image acquisition unit 11 that acquires video of a vehicle occupant, a beverage intake behavior determination unit 12 that determines whether the occupant has taken a beverage inside the vehicle based on the video acquired by the image acquisition unit 11, a vital information acquisition unit 13 that acquires vital information of the occupant, and, if the beverage intake behavior determination unit 12 determines that the occupant has taken a beverage, a drinking state determination unit 14 that determines whether the occupant has drunk alcohol based on the vital information acquired by the vital information acquisition unit 13. Therefore, the drinking determination device 3 can reduce false detections of drinking state compared to the monitoring device disclosed in Patent Document 1.
[0045] Second Embodiment In a second embodiment, a drinking alcohol determination device 3 including a vehicle information acquisition unit 16 that acquires vehicle information indicating the steering angle of the steering wheel of the vehicle will be described.
[0046] FIG. 6 is a configuration diagram showing a drinking alcohol determination device 3 according to embodiment 2. In FIG. 6, the same reference numerals as those in FIG. 1 indicate the same or corresponding parts, and therefore detailed description thereof will be omitted. FIG. 7 is a hardware configuration diagram showing the hardware of the drinking alcohol determination device 3 according to embodiment 2. In FIG. 7, the same reference numerals as those in FIG. 2 indicate the same or corresponding parts, and therefore detailed description thereof will be omitted. The drinking alcohol determination device 3 shown in FIG. 6 includes an image acquisition unit 11, a vehicle information acquisition unit 16, a beverage intake behavior determination unit 17, a vital information acquisition unit 13, a drinking state determination unit 14, and a warning output unit 15. A steering angle sensor 5 measures the steering angle of the steering wheel of the vehicle, and outputs vehicle information indicating the steering angle of the steering wheel to the drinking alcohol determination device 3.
[0047] The vehicle information acquisition unit 16 is realized, for example, by a vehicle information acquisition circuit 26 shown in Fig. 7. The vehicle information acquisition unit 16 acquires vehicle information indicating the steering angle of the vehicle's steering wheel from the steering angle sensor 5. However, the source from which the vehicle information is acquired is not limited to the steering angle sensor 5, and may be, for example, the vehicle control device 4. The vehicle information acquisition unit 16 outputs the vehicle information to the beverage intake behavior determination unit 17.
[0048] The beverage intake behavior determination unit 17 is realized, for example, by the beverage intake behavior determination circuit 27 shown in FIG. 7 . The beverage intake behavior determination unit 17 acquires captured video of the occupant from the video acquisition unit 11, and acquires vehicle information from the vehicle information acquisition unit 16. The beverage intake behavior determination unit 17 determines whether the occupant has taken an action to consume a beverage in the vehicle based on the captured video only if the steering angle indicated by the vehicle information is equal to or less than a threshold value. The threshold value may be stored in an internal memory of the beverage intake behavior determination unit 17, or may be provided from outside the drinking determination device 3. The beverage intake behavior determination unit 17 outputs a determination result indicating whether the occupant has taken an action to consume a beverage to the drinking level determination unit 14.
[0049] 6 assumes that each of the components of the drinking determination device 3, namely, the image acquisition unit 11, the vehicle information acquisition unit 16, the beverage intake behavior determination unit 17, the vital information acquisition unit 13, the drinking state determination unit 14, and the warning output unit 15, is realized by dedicated hardware such as that shown in FIG. 7. That is, it assumes that the drinking determination device 3 is realized by an image acquisition circuit 21, a vehicle information acquisition circuit 26, a beverage intake behavior determination circuit 27, a vital information acquisition circuit 23, a drinking state determination circuit 24, and a warning output circuit 25. Each of the image acquisition circuit 21, the vehicle information acquisition circuit 26, the beverage intake behavior determination circuit 27, the vital information acquisition circuit 23, the drinking state determination circuit 24, and the warning output circuit 25 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.
[0050] The components of the drinking alcohol determination device 3 are not limited to those realized by dedicated hardware, and the drinking alcohol determination device 3 may be realized by software, firmware, or a combination of software and firmware. When the drinking alcohol determination device 3 is realized by software, firmware, or the like, a program for causing a computer to execute the processing procedures of the image acquisition unit 11, the vehicle information acquisition unit 16, the beverage intake behavior determination unit 17, the vital information acquisition unit 13, the drinking state determination unit 14, and the warning output unit 15 is stored in a memory 31 shown in Fig. 3. Then, a processor 32 shown in Fig. 3 executes the program stored in the memory 31.
[0051] 7 shows an example in which each of the components of the drinking determination device 3 is realized by dedicated hardware, while Fig. 3 shows an example in which the drinking determination device 3 is realized by software, firmware, etc. However, this is merely an example, and some of the components of the drinking determination device 3 may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.
[0052] Next, the operation of the drinking determination device 3 shown in Fig. 6 will be described. However, other than the vehicle information acquisition unit 16 and the beverage intake behavior determination unit 17, the drinking determination device 3 shown in Fig. 1 is the same as that shown in Fig. 1. Therefore, the operation of the vehicle information acquisition unit 16 and the beverage intake behavior determination unit 17 will be mainly described here.
[0053] The steering angle sensor 5 measures the steering angle of the steering wheel of the vehicle. The steering angle sensor 5 outputs vehicle information indicating the steering angle of the steering wheel to the drinking determination device 3. The vehicle information acquisition unit 16 acquires the vehicle information from the steering angle sensor 5. The vehicle information acquisition unit 16 outputs the vehicle information to the beverage intake behavior determination unit 17.
[0054] The beverage intake behavior determination unit 17 acquires captured video of the occupant from the video acquisition unit 11 and vehicle information from the vehicle information acquisition unit 16. When the steering angle of the steering wheel is large, the vehicle's traveling direction changes significantly. On the other hand, when the steering angle of the steering wheel is small, particularly when the steering angle is 0 degrees, the vehicle's traveling direction does not change. Therefore, when the steering angle of the steering wheel is large, the occupant needs to concentrate on driving the vehicle more than when the steering angle of the steering wheel is small. Therefore, when the steering angle of the steering wheel is large, the occupant is less likely to drink alcohol. The beverage intake behavior determination unit 17 determines whether the occupant has taken a beverage in the vehicle based on the captured video only when the steering angle indicated by the vehicle information is equal to or smaller than a threshold. In other words, only when the occupant has little need to concentrate on driving the vehicle, the beverage intake behavior determination unit 17 determines whether the occupant has taken a beverage in the vehicle based on the captured video. The beverage intake behavior determination unit 17 outputs a determination result indicating whether the occupant has taken a beverage to the drinking level determination unit 14.
[0055] In the second embodiment described above, the drinking determination device 3 shown in Fig. 6 is configured to include a vehicle information acquisition unit 16 that acquires vehicle information indicating the steering angle of the steering wheel of the vehicle, and a beverage intake behavior determination unit 17 that determines whether an occupant has taken the action of consuming a beverage inside the vehicle only if the steering angle indicated by the vehicle information acquisition unit 16 is equal to or less than a threshold value. Therefore, like the drinking determination device 3 shown in Fig. 1, the drinking determination device 3 shown in Fig. 6 can reduce false detections of drinking status compared to the monitoring device disclosed in Patent Document 1, and can also reduce the processing load of determining the behavior of consuming a beverage compared to the drinking determination device 3 shown in Fig. 1.
[0056] Embodiment 3 In embodiment 3, a drinking state determination device 3 will be described in which the drinking state determination unit 18 determines whether or not an occupant is drinking alcohol when the beverage intake behavior determination unit 12 has not determined that the occupant has taken an action to consume a beverage, and if it determines that the occupant is drinking alcohol, determines that an abnormality has occurred in the occupant.
[0057] Fig. 8 is a configuration diagram showing a drinking alcohol determination device 3 according to embodiment 3. In Fig. 8, the same reference numerals as those in Figs. 1 and 6 indicate the same or corresponding parts, and therefore detailed description thereof will be omitted. Fig. 9 is a hardware configuration diagram showing the hardware of the drinking alcohol determination device 3 according to embodiment 3. In Fig. 9, the same reference numerals as those in Figs. 2 and 7 indicate the same or corresponding parts, and therefore detailed description thereof will be omitted. The drinking alcohol determination device 3 shown in Fig. 8 includes an image acquisition unit 11, a beverage intake behavior determination unit 12, a vital information acquisition unit 13, a drinking state determination unit 18, and a warning output unit 15.
[0058] The drinking state determination unit 18 is realized, for example, by a drinking state determination circuit 28 shown in FIG. 9 . The drinking state determination unit 18 acquires a determination result from the beverage intake behavior determination unit 12, acquires vital sign information from the vital sign information acquisition unit 13, and acquires captured video from the video acquisition unit 11. Similar to the drinking state determination unit 14 shown in FIG. 1 , if the beverage intake behavior determination unit 12 determines that the occupant has taken a beverage, the drinking state determination unit 18 determines whether the occupant is drinking based on the vital sign information or the captured video. Unlike the drinking state determination unit 14 shown in FIG. 1 , the drinking state determination unit 18 determines whether the occupant is drinking even if the beverage intake behavior determination unit 12 does not determine that the occupant has taken a beverage. If the drinking state determination unit 18 determines that the occupant is drinking, it determines that an abnormality has occurred in the occupant. The drinking state determination unit 18 outputs to the warning output unit 15 a determination result indicating whether or not the occupant is drunk and a determination result indicating that an abnormality has occurred in the occupant.
[0059] The drinking state determination device 3 shown in Fig. 8 is one in which the drinking state determination unit 18 is applied to the drinking state determination device 3 shown in Fig. 1. However, this is merely an example, and the drinking state determination unit 18 may also be applied to the drinking state determination device 3 shown in Fig. 6.
[0060] 8, it is assumed that each of the components of the drinking determination device 3, namely, the image acquisition unit 11, the beverage intake behavior determination unit 12, the vital information acquisition unit 13, the drinking state determination unit 18, and the warning output unit 15, is realized by dedicated hardware such as that shown in Fig. 9. That is, it is assumed that the drinking determination device 3 is realized by an image acquisition circuit 21, a beverage intake behavior determination circuit 22, a vital information acquisition circuit 23, a drinking state determination circuit 28, and a warning output circuit 25. Each of the image acquisition circuit 21, the beverage intake behavior determination circuit 22, the vital information acquisition circuit 23, the drinking state determination circuit 28, and the warning output circuit 25 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.
[0061] The components of the drinking determination device 3 are not limited to those realized by dedicated hardware, and the drinking determination device 3 may be realized by software, firmware, or a combination of software and firmware. When the drinking determination device 3 is realized by software, firmware, or the like, a program for causing a computer to execute the processing procedures of the image acquisition unit 11, the beverage intake behavior determination unit 12, the vital information acquisition unit 13, the drinking state determination unit 18, and the warning output unit 15 is stored in a memory 31 shown in Fig. 3. Then, a processor 32 shown in Fig. 3 executes the program stored in the memory 31.
[0062] 9 shows an example in which each of the components of the drinking determination device 3 is realized by dedicated hardware, while Fig. 3 shows an example in which the drinking determination device 3 is realized by software, firmware, etc. However, this is merely an example, and some of the components of the drinking determination device 3 may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.
[0063] Next, the operation of the drinking level determination device 3 shown in Fig. 8 will be described. Since the drinking level determination device 3 shown in Fig. 1 is the same as the drinking level determination device 3 shown in Fig. 1 except for the drinking level determination unit 18, only the operation of the drinking level determination unit 18 will be described here.
[0064] The drinking level determination unit 18 acquires the determination result from the beverage intake behavior determination unit 12. The drinking level determination unit 18 also acquires vital sign information from the vital sign information acquisition unit 13 and acquires captured video from the video acquisition unit 11. Similar to the drinking level determination unit 14 shown in FIG. 1 , if the beverage intake behavior determination unit 12 determines that the occupant has taken a beverage, the drinking level determination unit 18 determines whether the occupant is drinking alcohol based on the vital sign information or the captured video. The drinking level determination unit 18 outputs the determination result indicating whether the occupant is drinking alcohol to the warning output unit 15.
[0065] Unlike the drinking state determination unit 14 shown in FIG. 1 , the drinking state determination unit 18 determines whether the occupant is drinking alcohol based on vital sign information or captured video even when the beverage intake behavior determination unit 12 has not determined that the occupant has taken an action to consume a beverage. When the occupant has not taken an action to consume a beverage, there is no possibility that the occupant will be drinking alcohol. Therefore, a determination that the occupant is drinking alcohol when the occupant has not taken an action to consume a beverage is likely to be an erroneous determination due to an abnormality other than drinking alcohol occurring in the occupant. If the drinking state determination unit 18 determines that the occupant is drinking alcohol when it has not determined that the occupant has taken an action to consume a beverage, it determines that an abnormality has occurred in the occupant. The drinking state determination unit 18 outputs a determination result indicating that an abnormality has occurred in the occupant to the warning output unit 15.
[0066] The warning output unit 15 obtains a determination result indicating whether or not the occupant is drunk from the drinking state determination unit 18. If the drinking state determination unit 18 determines that the occupant is drunk, the warning output unit 15 outputs warning information to the vehicle control device 4, thereby causing the vehicle control device 4 to output a warning. If the drinking state determination unit 18 outputs a determination result indicating that an abnormality has occurred in the occupant, the warning output unit 15 outputs warning information to the vehicle control device 4 indicating that an abnormality has occurred in the occupant, thereby causing the vehicle control device 4 to issue a warning.
[0067] In the third embodiment described above, the drinking level determination device 3 shown in Fig. 8 is configured so that the drinking level determination unit 18 determines whether the occupant is drinking when the beverage intake behavior determination unit 12 has not determined that the occupant has taken a beverage, and if it determines that the occupant is drinking, determines that an abnormality has occurred in the occupant. Therefore, like the drinking level determination device 3 shown in Fig. 1, the drinking level determination device 3 shown in Fig. 8 can reduce false detections of the drinking level compared to the monitoring device disclosed in Patent Document 1, and can also alert an occupant who is experiencing an abnormality.
[0068] Fourth Embodiment In a fourth embodiment, a drinking alcohol determination device 3 including an alcohol concentration determination unit 19 that determines whether or not the alcohol concentration contained in the breath of a passenger is equal to or higher than the permissible concentration will be described.
[0069] FIG. 10 is a configuration diagram showing a drinking alcohol determination device 3 according to embodiment 4. In FIG. 10, the same reference numerals as those in FIGS. 1, 6, and 8 indicate the same or corresponding parts, and therefore detailed description thereof will be omitted. FIG. 11 is a hardware configuration diagram showing the hardware of the drinking alcohol determination device 3 according to embodiment 4. In FIG. 11, the same reference numerals as those in FIGS. 2, 7, and 9 indicate the same or corresponding parts, and therefore detailed description thereof will be omitted. The drinking alcohol determination device 3 shown in FIG. 10 includes an image acquisition unit 11, a beverage intake behavior determination unit 12, a vital sign information acquisition unit 13, a drinking state determination unit 14, a warning output unit 15, an alcohol concentration determination unit 19, and a vehicle control unit 20. The breath sensor 6 measures the alcohol concentration contained in the breath of the occupant and outputs concentration information indicating the alcohol concentration to the drinking alcohol determination device 3.
[0070] The alcohol concentration determination unit 19 is realized, for example, by an alcohol concentration determination circuit 29 shown in FIG. 11 . The alcohol concentration determination unit 19 acquires concentration information from the breath sensor 6. The alcohol concentration determination unit 19 determines whether the alcohol concentration indicated by the concentration information is equal to or higher than the permissible concentration. The permissible concentration may be stored in an internal memory of the alcohol concentration determination unit 19, or may be provided from outside the drinking determination device 3. The alcohol concentration determination unit 19 outputs a determination result indicating whether the alcohol concentration is equal to or higher than the permissible concentration to each of the video acquisition unit 11, the vital sign information acquisition unit 13, and the vehicle control unit 20.
[0071] The vehicle control unit 20 is realized, for example, by a vehicle control circuit 30 shown in Fig. 11. The vehicle control unit 20 obtains a determination result indicating whether or not the alcohol concentration is equal to or higher than the permissible concentration from the alcohol concentration determination unit 19. If the alcohol concentration determination unit 19 determines that the alcohol concentration is equal to or higher than the permissible concentration, the vehicle control unit 20 outputs a control signal to the vehicle control device 4 to interlock the occupant from driving the vehicle.
[0072] In the drinking determination device 3 shown in Fig. 10, the alcohol concentration determination unit 19 and the vehicle control unit 20 are applied to the drinking determination device 3 shown in Fig. 1. However, this is merely an example, and the alcohol concentration determination unit 19 and the vehicle control unit 20 may also be applied to the drinking determination device 3 shown in Fig. 6 or the drinking determination device 3 shown in Fig. 8.
[0073] 10 assumes that each of the components of the drinking determination device 3, namely, the image acquisition unit 11, the beverage intake behavior determination unit 12, the vital information acquisition unit 13, the drinking state determination unit 14, the warning output unit 15, the alcohol concentration determination unit 19, and the vehicle control unit 20, is realized by dedicated hardware such as that shown in FIG. 11. That is, it assumes that the drinking determination device 3 is realized by an image acquisition circuit 21, a beverage intake behavior determination circuit 22, a vital information acquisition circuit 23, the drinking state determination circuit 24, the warning output circuit 25, the alcohol concentration determination circuit 29, and the vehicle control circuit 30. Each of the image acquisition circuit 21, the beverage intake behavior determination circuit 22, the vital information acquisition circuit 23, the drinking state determination circuit 24, the warning output circuit 25, the alcohol concentration determination circuit 29, and the vehicle control circuit 30 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.
[0074] The components of the drinking alcohol determination device 3 are not limited to those realized by dedicated hardware, and the drinking alcohol determination device 3 may be realized by software, firmware, or a combination of software and firmware. When the drinking alcohol determination device 3 is realized by software, firmware, or the like, a memory 31 shown in Fig. 3 stores programs for causing a computer to execute the processing procedures of the image acquisition unit 11, the beverage intake behavior determination unit 12, the vital information acquisition unit 13, the drinking state determination unit 14, the warning output unit 15, the alcohol concentration determination unit 19, and the vehicle control unit 20. A processor 32 shown in Fig. 3 then executes the programs stored in the memory 31.
[0075] 11 shows an example in which each of the components of the drinking determination device 3 is realized by dedicated hardware, while Fig. 3 shows an example in which the drinking determination device 3 is realized by software, firmware, etc. However, this is merely an example, and some of the components of the drinking determination device 3 may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.
[0076] Next, the operation of the drinking determination device 3 shown in Fig. 10 will be described. Since the components other than the alcohol concentration determination unit 19 and the vehicle control unit 20 are the same as those of the drinking determination device 3 shown in Fig. 1, the operation of the alcohol concentration determination unit 19 and the vehicle control unit 20 will be mainly described here.
[0077] The breath sensor 6 measures the alcohol concentration contained in the breath of the occupant after the occupant gets into the vehicle, for example, when the occupant turns on the ignition switch of the vehicle. The timing at which the breath sensor 6 measures the alcohol concentration is not limited to when the occupant turns on the ignition switch, but may be, for example, when the occupant gets into the vehicle. The breath sensor 6 outputs concentration information indicating the measured alcohol concentration to the drinking determination device 3.
[0078] The alcohol concentration determination unit 19 acquires concentration information from the breath sensor 6. The alcohol concentration determination unit 19 determines whether the alcohol concentration indicated by the concentration information is equal to or higher than the permissible concentration. If the alcohol concentration is equal to or higher than the permissible concentration, the occupant has been drinking, and it is necessary to prevent the occupant from driving the vehicle. The alcohol concentration determination unit 19 outputs a determination result indicating whether the alcohol concentration is equal to or higher than the permissible concentration to each of the video acquisition unit 11, the vital sign information acquisition unit 13, and the vehicle control unit 20.
[0079] The video acquisition unit 11 and the vital information acquisition unit 13 each acquire a determination result indicating whether the alcohol concentration is equal to or higher than the permissible concentration from the alcohol concentration determination unit 19. If the determination result indicates that the alcohol concentration is equal to or higher than the permissible concentration, the video acquisition unit 11 performs a process of acquiring the captured video since the vehicle control device 4 prevents the occupant from driving the vehicle. If the determination result indicates that the alcohol concentration is equal to or higher than the permissible concentration, the vital information acquisition unit 13 performs a process of acquiring vital information since the vehicle control device 4 prevents the occupant from driving the vehicle.
[0080] The vehicle control unit 20 obtains a determination result indicating whether or not the alcohol concentration is equal to or higher than the permissible concentration from the alcohol concentration determination unit 19. If the determination result indicates that the alcohol concentration is equal to or higher than the permissible concentration, the vehicle control unit 20 outputs a control signal to the vehicle control device 4 to interlock the occupant from driving the vehicle.
[0081] When a control signal for interlocking vehicle driving is output from the vehicle control unit 20, the vehicle control device 4 will not start the engine even if the occupant performs an engine start operation. Furthermore, when a control signal for interlocking vehicle driving is output from the vehicle control unit 20, the vehicle control device 4 will, for example, display a warning on the vehicle's instrument panel indicating that the occupant cannot drive the vehicle due to drinking.
[0082] In the above-described fourth embodiment, the drinking alcohol determination device 3 shown in Fig. 10 is configured to include an alcohol concentration determination unit 19 that determines whether the alcohol concentration contained in the occupant's breath is equal to or higher than the permissible concentration, and a vehicle control unit 20 that interlocks the occupant from driving the vehicle if the alcohol concentration determination unit 19 determines that the alcohol concentration is equal to or higher than the permissible concentration. Therefore, similar to the drinking alcohol determination device 3 shown in Fig. 1, the drinking alcohol determination device 3 shown in Fig. 10 can reduce false detections of drinking levels compared to the monitoring device disclosed in Patent Document 1, and can also prevent drunk occupants from driving the vehicle.
[0083] In addition, the present disclosure allows for free combination of the respective embodiments, modification of any of the components of the respective embodiments, or omission of any of the components of the respective embodiments.
[0084] The present disclosure is suitable for a drinking determination device and a drinking determination method.
[0085] REFERENCE SIGNS LIST 1 Camera, 2 Vital sign sensor, 3 Drinking status determination device, 4 Vehicle control device, 5 Steering angle sensor, 6 Breath sensor, 11 Image acquisition unit, 12 Drinking behavior determination unit, 13 Vital sign information acquisition unit, 14 Drinking status determination unit, 15 Warning output unit, 16 Vehicle information acquisition unit, 17 Drinking behavior determination unit, 18 Drinking status determination unit, 19 Alcohol concentration determination unit, 20 Vehicle control unit, 21 Image acquisition circuit, 22 Drinking behavior determination circuit, 23 Vital sign information acquisition circuit, 24 Drinking status determination circuit, 25 Warning output circuit, 26 Vehicle information acquisition, 27 Drinking behavior determination circuit, 28 Drinking status determination circuit, 29 Alcohol concentration determination circuit, 30 Vehicle control circuit, 31 Memory, 32 Processor.
Claims
1. A drinking alcohol determination device comprising: an image acquisition unit that acquires video footage of a occupant in a vehicle; a beverage intake behavior determination unit that determines whether the occupant has taken the action of consuming a beverage inside the vehicle based on the video footage acquired by the image acquisition unit; a vital information acquisition unit that acquires vital sign information of the occupant; and an alcohol consumption state determination unit that, if the beverage intake behavior determination unit determines that the occupant has taken the action of consuming a beverage, determines whether the occupant has consumed alcohol based on the vital sign information acquired by the vital information acquisition unit.
2. The drinking state determination device according to claim 1, further comprising a warning output section which outputs a warning to the occupant when the drinking state determination section determines that the occupant has drunk alcohol.
3. The drinking judgment device of claim 1, characterized in that the beverage intake behavior judgment unit detects changes in the position of the occupant's head, the position of the occupant's hands, and the angle of the occupant's head from the captured image acquired by the image acquisition unit, and judges whether the occupant has taken the action of consuming a beverage inside the vehicle based on the changes in the position of the head, the position of the hands, and the angle of the head.
4. The drinking state determination unit of the drinking determination device described in claim 1 is characterized in that, when the beverage intake behavior determination unit determines that the behavior of consuming a beverage has been performed, the drinking state determination unit determines whether the occupant has consumed alcohol based on the vital information acquired by the vital information acquisition unit or the captured video acquired by the video acquisition unit.
5. The drinking alcohol determination device according to claim 1, characterized in that the vital information acquisition unit acquires the vital information of the occupant from a vital sensor that measures the vital signs of the occupant.
6. The drunk driving determination device according to claim 1, characterized in that the vital information acquisition unit acquires vital information of the occupant based on the captured image acquired by the image acquisition unit.
7. The drinking determination device as described in claim 1, further comprising a vehicle information acquisition unit that acquires vehicle information indicating a steering angle of the steering wheel of the vehicle, and the beverage intake behavior determination unit determines whether or not the occupant has taken the action of consuming a beverage inside the vehicle only if the steering angle indicated by the vehicle information acquired by the vehicle information acquisition unit is equal to or less than a threshold value.
8. The drinking state determination unit of the drinking determination device described in claim 4 is characterized in that when the beverage intake behavior determination unit has not determined that the behavior of consuming a beverage has been performed, it determines whether the occupant has consumed alcohol, and if it determines that the occupant has consumed alcohol, it determines that an abnormality has occurred in the occupant.
9. The drinking alcohol determination device according to claim 1, further comprising: an alcohol concentration determination unit that determines whether or not the alcohol concentration contained in the breath of the occupant is equal to or higher than a permissible concentration; and a vehicle control unit that interlocks the occupant from driving the vehicle if the alcohol concentration determination unit determines that the alcohol concentration is equal to or higher than the permissible concentration.
10. A method for determining whether or not the occupant has consumed alcohol, in which an image acquisition unit acquires video footage of an occupant in a vehicle, a beverage intake behavior determination unit determines whether or not the occupant has consumed a beverage inside the vehicle based on the video footage acquired by the image acquisition unit, a vital information acquisition unit acquires vital information of the occupant, and a drinking state determination unit determines whether or not the occupant has consumed alcohol based on the vital information acquired by the vital information acquisition unit if the beverage intake behavior determination unit determines that the occupant has consumed a beverage.
Citation Information
Patent Citations
Drunken driving prevention device
JP2009258855A
Vehicle drive assist system
JP2015232843A
Drunk state detection device
JP2023036289A
Drunken driving prevention device, drunken driving prevention method and drunken driving prevention program
JP2023061171A
Sterilization control method of bidet
KR102566488B1
Cited By
Beverage intake detection device
JP7701106B1
